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I .INTRODUCTION 

In  any  environment  where  one  organization  contracts 
with  another  there  arises  concern  over  whether  the 
contractor  is  performing  up  to  the  standards  expected  by 
the  organization  which  employs  him.  This  is  especially 
true  in  today's  Navy,  with  its  commitment  to  exploring 
the  possibilities  of  civilian  contractors  taking  over 
functions  which  have  heretofore  been  run  by  Naval 
personnel  and  civil  service  employees.  This  commitment  to 
exploring  commercial  service  contracts  was  occasioned  by 
senior  policy  makers'  determination  to  obtain  quality 
services  at  minimum  prices. 

This  senior  policy  guidance  has  had  significant 
impact  upon  the  Naval  support  establishment  and  has 
resulted  in  numerous  studies  to  determine  the  most 
efficient  means  of  obtaining  a  host  of  services  currently 
performed  by  the  Navy  itself. 

Of  particular  interest  is  the  possibility  that  the 
operations  of  some  or  all  of  the  Navy's  regional  data 
automation  centers  (NARDACS)  may  come  under  commercial 
service  contract  operation.  Because  of  the  tremendous 
amount  of  data  processed  by  these  centers,  they  are 
extremely  important  to  the  smooth  operation  of  the  fleet. 
The   adverse  consequences  of  poorly  run  ADP  services   can 


scarcely  be  overestimated.  It  is  of  critical  importance 
that  there  exists  a  sure,  secure  method  of  assuring  the 
quality  of  ADP  services  operated  under  service  contract. 
This,  then,  is  a  description  of  the  methodology  used  by 
one  command  to  automate  an  existing  quality  assurance 
standard  in  order  to  ensure  its  proper  operation. 


II.  BACKGROUND 
A.  PROJECT  ORIGIN 

The  Naval  Regional  Data  Automation  Center  (NARDAC), 
San  Francisco  CA,  established  in  1978  as  a  tenant  command 
at  Naval  Air  Station  Alameda,  is  an  echelon  three  shore 
activity  under  the  Commander,  Naval  Data  Automation 
Command  ( COMNAVDAC ) .  NARDAC 's  mission  is  to  provide 
automated  data  processing  (ADP)  services  to  Naval 
activities  in  the  San  Francisco  area  and  wherever  else 
directed  by  COMNAVDAC.  Commands  supported  by  NARDAC 
include  Naval  Air  Rework  Facility,  Alameda;  Naval  Air 
Station,  Alameda;  Naval  Air  Station,  Moffett  Field;  Naval 
Air  Station,  Lemoore;  Naval  Support  Activity,  Treasure 
Island;  Naval  Supply  Center,  Oakland;  the  Commander  in 
Chief,  United  States  Pacific  Fleet;  and  the  Fleet 
Accounting  and  Disbursing  Center,  San  Diego.  In  order  to 
support  this  mission,  NARDAC  also  manages  and  directs 
remote  facilities  in  order  to  provide  local  data  proces- 
sing support  in  coordination  with  the  regional  center;  it 
designs,  develops  and  maintains  automated  data  systems; 
and  it  performs  such  other  tasks  as  may  be  directed  by 
COMNAVDAC . 

NARDAC  is  in  operation  twenty-four  hours  daily,  every 
day   of   the   year.   In  the  course  of  the   average   day's 
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operation,  there  are  approximately  ten  thousand 
individual  jobs  completed.  These  jobs  often  include  the 
production  of  physical  output  product:  printed  pages, 
Hollerith  cards,  microfiche,  etc.  This  output  is  provided 
to  end  users  in  a  variety  of  ways:  transmitted  electron- 
ically; physically  shipped  to  the  user,  left  available 
for  pickup  at  the  center,  or  one  of  several  remote  sites; 
or  mailed. 

NARDAC  San  Francisco  is  staffed  by  a  mixture  of  Naval 
personnel  and  civil  service  employees  under  the  command 
of  a  Navy  captain.  There  are  subordinate  remote  activi- 
ties at  NAS  Moffett  Field  and  NAS  Lemoore ,  each  with  its 
own  staff  under  the  direction  of  an  officer  in  charge, 
who  reports  to  the  Commanding  Officer,  NARDAC  San 
Francisco.  The  total  staffing,  including  personnel  at  the 
remote  activities,  is  approximately  50  military  and  280 
civil  service  employees. 

In  September  1982,  the  Chief  of  Naval  Operations 
notified  the  Naval  Regional  Data  Automation  Center,  San 
Francisco  that  Data  Automation  Services  and  System 
Design,  Development,  and  Programming  services  currently 
being  conducted  in-house  by  NARDAC  San  Francisco  would  be 
included  in  cost  studies  conducted  in  accordance  with  OMB 
Circular  No.   A-76  [Ref.   1].   The  Commander,   Naval  Data 
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Automation  Command  tasked  NARDAC  San  Francisco  with 
developing  a  Commercial  Activities  ( CA )  Program  in 
November  1982  [Refs.  2  and  3].  The  purpose  of  the  program 
is  to  explore  the  possibility  of  selected  portions  of 
NARDAC 's  operation  being  run  by  a  civilian  contractor 
under  a  service  contract  whereby  the  contractor  would 
operate  NARDAC,  in  lieu  of  military  and  civilian 
personnel,  using  government  furnished  equipment  and 
supplies.  Included  in  this  tasking  are  the  requirements 
for  the  Performance  Work  Statement  and  Quality  Assurance 
Package  to  be  completed  by  1  June  1984  and  the  entire  CA 
study  to  be  finished  and  the  decision  made  by  1  October 
1985  to  contract  with  a  commercial  source  or  to  leave  the 
operation  of  NARDAC  San  Francisco  as  an  in-house 
function. 

B.  DISCUSSION  OF  OMB  CIRCULAR  NO.  A-76 

The  Office  of  Manpower  and  Budget's  Circular  No.  A- 
76,  Performance  of  Commercial  Activities,  [Ref.  4] 
establishes  Federal  policy  regarding  the  performance  of 
commercial  activities.  A  commercial  activity  is  defined 
by  OMB  Circular  No.  A-76  as  an  activity  "...which  is 
operated  by  a  Federal  executive  agency  and  which  provides 
a  product  or  service  which  could  be  obtained  from  a 
commercial  source.  A  commercial  activity  is  not  a  Gover- 
nment  function."  OMB  Circular  No.   A-76  is  based  on   two 
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key  concepts:  one,  that  the  government  is  not  in  compe- 
tition with  its  citizens;  and  two,  that  the  competitive, 
free  enterprise  system  is  the  primary  source  of  national 
economic  strength  and  that  competition  enhances  quality, 
economy  and  productivity. 

The  government  policy  set  forth  in  OMB  Circular  No.  A- 
76  is  three-fold:  in  order  to  achieve  economy  and  enhance 
productivity  where  possible,  comparison  of  the  cost  of 
contracting  and  the  cost  of  in-house  performance  shall  be 
done  to  determine  who  does  the  work;  to  retain  certain 
functions  in-house  as  being  inherently  governmental  in 
nature  and  not  in  competition  with  the  commercial  sector; 
and  to  rely,  to  the  greatest  extent  possible,  on  the 
commercial  sector  to  provide  commercial  services. 

There  are  certain  limitations  affecting  the  scope  of 
OMB  Circular  No.  A-76,  but  the  original  document  and  its 
supplements  apply  to  all  executive  agencies.  It  provides 
for  government  performance  of  a  commercial  activity  under 
one  of  the  following  conditions: 

1.  If    no    satisfactory   commercial   source    is 
available; 

2.  If   the  performance  of  the  activity  is   required 
for  the  national  defense; 
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3.  If  patient  care  at  a  hospital  operated  by  the 
government  would  be  served  best  by  in-house 
performance ; 

4.  If  the  government  is  operating,  or  can  operate 
the  activity  at  lower  cost  than  a  qualified 
commercial  source. 

In  order  to  ensure  proper  performance  by  a  contractor, 
Supplement  1  to  OMB  Circular  No.  A-76  [Ref.  4:  pp.  1-1] 
mandates  that  Contract  Administration  personnel  develop  a 
Quality  Assurance  and  Surveillance  Plan  in  accordance 
with  Supplement  2  to  OMB  Circular  No.  A-76,  published 
separately  as  Office  of  Federal  Procurement  Policy 
Pamphlet  No.  4  (hereafter  referred  to  as  OFPP  4).  This 
publication  specifies  the  general  methodology  for  the 
establishment  and  conduct  of  Quality  Assurance  and 
Surveillance  Programs  for  use  in  Commercial  Activities 
Programs  [Ref.  5:  pp.  43  -  74].  The  Commander,  Naval  Data 
Automation  Command  notified  NARDAC ,  San  Francisco  that 
even  though  OFPP  4  is  currently  under  revision,  "...The 
Oct  80  version  of  OFPP  4  remains  in  effect  until  the 
Office  of  Management  and  Budget  (OMB)  issues  an  edited, 
clarified  version.  No  major  procedural  changes  to  OFPP  4 
are  anticipated.  Its  use  is  mandatory  for  all  Navy  CA 
cost  comparisons."  [Ref.   6:  p.  2].  In  a  memorandum  dated 
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20  March  1984  the  Assistant  Secretary  of  Defense  for 
Manpower,  Installations,  and  Logistics  has  expanded  the 
scope  of  this  Quality  Assurance  and  Surveillance  Plan  to 
require  its  use  by  facilities  retaining  performance  of 
commercial  services  in-house.  This  policy  requires  the 
same  levels  of  performance  of  the  Navy  operated  activity 
as  if  the  contract  had  been  let  to  a  private  contractor 
[Ref.  7:  p.A-1]. 

C.  GUIDANCE  ON  SURVEILLANCE  PLANS  FROM  OFPP  4 

Appended  as  Supplement  2  to  OMB  Circular  No.  A-76, 
Office  of  Federal  Procurement  Policy  Pamphlet  No.  4  [Ref. 
5:  pp.  43-74]  provides  specific  guidance  in  the  formula- 
tion of  Quality  Assurance  and  Surveillance  Plans  for  use 
by  Contracts  Administration  personnel.  The  pamphlet 
presents  three  key  ideas  as  bases  for  a  surveillance 
plan: 

1 .  Management  by  Exception .  When  the  government 
specifies  the  quality  assurance  procedure,  compliance 
by  the  contractor  with  that  QA  plan  is  the  desired 
output  service. 

2.  Performance   Indicator.   The   level   of   service 
provided   by  the  contractor  is  checked  and   monitored 
by    comparing    his   performance   with   the    values 
specified  in  the  Performance  Work  Statement  ( PWS ) . 
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3.  Problem  Location .  If  contractor  performance  values 
indicate  that  the  service  provided  by  the  contractor 
is  not  being  adequately  performed,  Quality  Assurance 
personnel  are  to  use  decision  tables  to  locate  the 
problem. 

Information  for  surveillance  purposes  can  come  from  a 
variety  of  sources:  management  information  systems  (MIS), 
random  sampling,  checklists,  and  formal  customer 
complaints.  Of  these  four  methods,  the  most  commonly 
applied  is  random  sampling  as  it  does  not  require  the 
inspection  of  each  individual  job. 

Using  a  random  sampling  technique,  Quality  Assurance 
personnel  sample  the  services  provided  by  the  contractor 
(or  the  same  services  conducted  in-house  [Ref.  7:  p. 
A-l])  in  order  to  determine  if  these  services  are  accep- 
table. This  type  of  surveillance  sampling  is  called 
acceptance  sampling  and  is  used  to  determine  whether  to 
accept  or  reject  the  contractor's  performance  over  a 
given  period  of  time.  In  this  case,  management  by 
exception  is  utilized  in  that  if  the  contractor's 
performance  is  accepted,  no  action  is  taken.  Should  the 
contractor's  performance  prove  unsatisfactory,  certain 
actions  are  taken,  depending  on  the  severity  and  duration 
of  unsatisfactory  performance.   These  actions  range   from 
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discussions  of  ways  and  means  of  correcting  the  problem, 
through  deducting  a  certain  portion  of  the  contractor 's 
remuneration  for  each  lot  found  unacceptable,  to  finally 
terminating  the  contract  for  default. 

The  procedure  for  deducting  a  portion  of  the 
contractor's  pay  is  termed  deduct  analysis.  Deduct 
analysis  is  performed  whenever  the  contractor's 
performance  for  a  given  day  falls  below  the  AQL.  In  this 
case,  the  contractor's  fee  for  the  day  in  question  is 
reduced  by  a  percentage  equal  to  the  percentage  of 
samples  which  were  found  to  be  defective.  For  instance: 
assume  that  for  a  lot  size  of  100,  20  samples  were  drawn; 
of  these  twenty  samples,  5  were  found  to  be  defective. 
These  5  samples  represent  25  percent  of  the  total  samples 
drawn.  Assuming  that  this  number  represents  an 
unacceptable  level  of  performance  (as  specified  in  the 
contract),  the  Commercial  Activities  manager  will  deduct 
25  percent  of  the  contractor's  fee  for  the  day  in 
question. 

As  specified  in  OFPP  4,  "The  basis  for  doing  random 
sampling  is  MIL-STD-105D,  Sampling  Procedures  and  Tables 
for  Inspection  by  Attributes  which  is  widely  understood 
and  used  by  both  the  government  and  contractors."  This 
standard   is   based  upon  the  concept   of   attributes.   An 
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attribute  is  a  feature  of  a  service  which  either   matches 
or  fails  to  match  a  standard. 

D.  DISCUSSION  OF  MIL-STD-1 05D 

Sampling  Procedures  and  Tables  for  Inspection  by 
Attributes  (MIL-STD-105D )  [Appendix  A]  is  the  current 
version  of  standard  military  sampling  procedures  for 
inspection  by  attributes  first  developed  during  World  War 
II.  The  standard  was  adopted  as  a  joint  service  standard 
in  1950/  and  was  modified  twice  before  discussions  with 
the  British  and  Canadian  forces  which  yielded  105D, 
issued  by  the  U.S.  in  1963.  In  1971  MIL-STD-105D  was 
adopted  by  the  American  National  Standards  Institute, 
becoming  ANSI  Standard  Z  1.4,  followed  by  adoption  by  the 
International  Standards  Organization  in  1973  as 
International  Standard  ISO/DIS  2859. 

In  order  to  implement  the  tables  in  MIL-STD-105D ,  four 
decisions  are  normally  made  prior  to  utilization: 

1.  The  AQL  or  acceptable  quality  level, 

2.  The  inspection  level, 

3.  The  lot  size,  and 

4.  The   type  of  sampling  plan   (single,   double,   or 
multiple ) . 


The  starting  point  for  any  utilization  of  MIL-STD-105D 

is  the  determination  of  what  proportion  of  defectives  (as 

given   in  MIL-STD-105D)  is  acceptable  to  the   user.   This 

proportion  of  defectives  is  called  the  acceptable  quality 

level  or  AQL.   In  his  text  Quality  Control  and  Industrial 

Statistics  [Ref.  8:  pp.  209  -245],  Duncan  states, 

It  is  expected  that  the  supplier  will  be 
submitting  for  inspection  a  series  of  lots  of 
his  product,  and  it  is  the  purpose  of  the 
sampling  procedures  of  Mil.  Std.  105D  so  to 
constrain  the  supplier  that  he  will  produce 
product  of  at  least  AQL  quality.  This  is  done 
not  only  through  the  acceptance  and  rejection  of 
a  particular  sampling  plan  but  by  providing  for 
a  shift  to  another,  tighter  sampling  plan 
whenever  there  is  evidence  that  the  contractor's 
product  has  deteriorated  from  the  agreed  upon 
AQL. 

There   is   the   further  provision  to   shift   to   another, 

reduced   sampling  plan  should  the  contractor  consistently 

produce   superior   product.   This  shift   to   the   reduced 

sampling   plan,   unlike   the  shift  to  the  tightened   plan 

described   above   by   Duncan  is   not   mandatory,   but   is 

accomplished   at   the   user's   option.    The   AQL's    are 

presented   in   MIL-STD-105D  as   fraction-defective   plans 

from   0.01  to  10.0  percent  and  as  def ects-per-unit   plans 

from  0.01  to  1000  defects  per  100  units. 

MIL-STD-105D  provides  for  seven  inspection  levels, 
which  vary  depending  on  the  degree  of  discrimination 
required:   the  more  discrimination,   the  more  samples  are 
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needed.  Among  the  three  general  levels,  Level  I  is  used 
where  reduced  discrimination  is  acceptable;  Level  II  is 
the  normal  inspection  level;  finally,  Level  III  is 
utilized  where  increased  discrimination  in  required. 

Given  an  AQL,  an  inspection  level,  lot  size,  and 
whether  single,  double,  or  multiple  inspections  are  to  be 
done,  MIL-STD-105D  provides  a  sampling  plan.  The  plan  may 
be  normal,  reduced,  or  tightened  as  results  dictate. 

Sampling  starts  with  normal  inspection.  If  two  out  of 
five  consecutive  lots  are  found  to  be  unsatisfactory  on 
original  inspection,  MIL-STD-105D  mandates  a  shift  to 
tightened  inspection.  Normal  inspection  is  re-instituted 
from  tightened  inspection  when  five  consecutive  lots  are 
accepted  on  original  inspection.  Should  ten  consecutive 
lots  fail  initial  inspection  from  tightened  inspection, 
inspection  is  suspended,  and  corrective  action  taken. 

When  in  normal  inspection,  should  ten  lots  be  accepted 
on  initial  inspection  the  administrator  in  charge  of 
quality  assurance  may  opt  to  shift  to  reduced  inspection. 
Inspection  remains  in  the  reduced  mode  until  a  lot  fails 
inspection,  or  alternatively  passes  inspection,  but  the 
number  of  rejected  units  is  relatively  large.  In  either 
case,  inspection  shifts  back  to  normal  inspection. 
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E.  BACKGROUND  SUMMARY 

At  this  point,   the  status  of  this  study  is  summarized 
as  follows: 

1.  NARDAC   San  Francisco  is  a  central   ADP   facility 
providing  a  variety  of  computing  services  to  customers 
at  several  geographic  locations. 

2.  NARDAC  is  in  continuous  operation,  completing  an 
average  of  ten  thousand  jobs  daily. 

3.  NARDAC  is  staffed  by  military  and  civil  service 
employees . 

4.  Higher  authority  has  mandated  that  a  cost 
comparison  study  be  conducted  in  accordance  with  OMB 
Circular  No.  A-76  in  order  to  determine  if  NARDAC 's 
operations  will  remain  in-house  or  will  be  contracted 
out  to  a  civilian  contractor  using  government 
furnished  equipment  and  supplies. 

5.  Continued  operation  of  commercial  activities  by 
the  government  is  allowed  by  OMB  Circular  No.  A-76  if 
the  government  can  operate  those  activities  at  a 
lower  cost  than  qualified  civilian  contractors. 

6.  In  order  to  ensure  that  any  contractor  performing 
commercial  services  under  the  auspices  of  OMB   Circu- 
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lar  No.  A-76  is  meeting  his  contractual  obligations 
regarding  timeliness  and  quality  of  product, 
Supplement  I  to  OMB  Circular  No.  A-76  mandates  that  a 
quality  assurance  and  surveillance  program  be 
developed  and  operated  by  CA  personnel.  This  program 
is  to  be  designed  and  conducted  in  accordance  with 
OFPP  4. 

7.  While  several  methods  for  the  conduct  of  quality 
assurance  programs  are  delineated  in  OFPP  4,  the 
statistical  method  is  most  widely  used  as  it  does  not 
require  examination  of  all  the  contractor's  product. 
The  statistical  methods  specified  in  OFPP  4  are 
contained  in  MIL-STD-10  5D ,  which  is  widely  used  and 
understood  by  both  government  agencies  and 
contractors . 

8.  MIL-STD-105D  is  based  on  the  random  sampling  of 
events  for  specified  attributes.  Before  the  standard 
can  be  utilized,  the  user  must  determine  what 
proportion  of  defective  performance  he  can  tolerate 
and  then  specify  that  as  an  AQL.  The  AQL  becomes,  in 
effect,  the  contractor's  'target';  he  must  perform  to 
at  least  that  standard  of  excellence  in  order  to 
receive  full  remuneration  for  his  efforts.  Further- 
more, the  contract  administrator  must  decide  how  much 
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discrimination   his  sampling  must  effect  and  whether 

each  sample  will  be  inspected  once,   twice,  or  more. 

Normally,   the  lot  size  must  also  be  decided  upon   as 
well . 
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III.  IMPLEMENTATION  OF  MIL-STD-105D  AT  NARDAC 

SAN  FRANCISCO 

Material  in  this  chapter  is  taken  from  a  series  of 
discussions  with  Mr.  Al  Hinds,  Naval  Regional  Data 
Automation  Command  (NARDAC)  San  Francisco,  CA  which  took 
place  from  September  1983  through  May  1984.  Mr.  Hinds  is 
conducting  the  Commercial  Activities  ( CA )  study  for  Data 
Processing  Services  at  NARDAC  San  Francisco. 

A.  DETAILS  REQUIRING  CLARIFICATION 

Several  particulars  need  be  resolved  before  MIL-STD- 
105D  can  be  implemented  as  the  method  of  choice  for 
quality  assurance  at  a  regional  data  center;  many  of 
these  concern  the  center's  massive  daily  output. 

What  constitutes  a  lot?  In  traditional  manufacturing 
where  MIL-STD-105D  was  first  implemented,  the  definition 
f  a  lot  as  a  given  number  of  pieces  of  physical  property 
Id  be  easily  effected.  In  the  world  of  ADP ,  any  pre- 
defined number  may  lead  to  difficulties.  These  difficult- 
ies arise  from  the  fact  that  the  output  of  a  computer 
center  for  just  one  day  is  apt  to  be  both  massive  and 
variable.  During  a  very  slow  period,  ten  thousand  units 
may  represent  several  day's  output,  while  during  times  of 
peak  load,  it  may  not  reflect  all  of  one  day's  jobs.  This 
notion   of  days  is  central  to  the  implementation  of   MIL- 
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STD-105D,  as  the  service  contracts  mandated  by  OMB 
Circular  No.  A-76  prescribe  payment  to  the  contractor  in 
terms  of  a  day's  efforts.  This  has  led  to  the  definition 
by  the  project  team  of  a  lot  as  being  the  output  for  one 
day's  work  by  the  contractor,  measured  from  0000  to  2359 
local  time.  While  this  definition  circumvents  the 
previously  mentioned  difficulties,  it  also  causes  a  few 
new  problems;  looking  at  the  MIL-STD-105D  tables  shown  in 
Appendix  A,  Table  1,  the  Sample  Size  Code  Table  shows 
code  letters  L  and  M  for  General  Inspection  Level  II  and 
lot  sizes  of  10,000  and  10,001  respectively.  Checking 
Table  II-A,  the  Master  Table  for  Normal  Inspection, 
Single  Sampling,  we  see  that  this  table  prescribes  sample 
sizes  of  200  and  315  samples  respectively.  While  this 
large  variability  in  sample  size  may  result  in  a  high 
degree  of  variability  in  the  workload  of  the  QA  personnel 
conducting  the  inspections  for  attributes,  the  only  other 
alternative  is  worse.  That  alternative  would  consist  of 
conducting  inspections  of  fixed  size,  but  variable  times. 
The  deduct  analysis  wherein  the  contractor  is  penalized 
for  poor  performance  would,  in  this  case  be  exceedingly 
difficult  to  implement. 

The  daily  variability  in  sample  size  complicates  the 
problem  of  obtaining  the  correct  information  from  the 
tables.   This   is   occasioned   due  to  the   fact   that   QA 
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personnel  must  now  utilize  the  entire  contents  of  each 
table  instead  of  just  one  line  because  the  sample  size 
may  vary  from  day  to  day. 

In  the  preceding  discussion,  note  that  the  specific 
attributes  which  determine  whether  a  sample  is  accepted 
or  rejected  are  left  undefined.  As  of  this  writing,  the 
Commercial  Activities  (CA)  staff  has  not  specifically 
determined  what  timeliness  or  quality  standards  must  be 
met  for  each  of  the  different  classes  of  jobs. 

Note  that  in  the  foregoing  discussion  it  was  assumed 
that  single,  as  opposed  to  multiple  sampling  would  be 
utilized.  Single  sampling  has,  in  fact,  been  mandated  by 
NARDAC  San  Francisco. 

For  the  purposes  of  this  application,  the  CA  staff 
could  discern  no  need  for  either  increased  nor  decreased 
discrimination.  For  this  reason,  General  Inspection  Level 
II  (Appendix  A,  Table  I),  normal  discrimination  was 
selected . 

Finally,  the  CA  staff  and  technical  director  at  NARDAC 
San  Francisco  determined  that  the  AQL  required  for 
performance  of  the  contract  would  be  2.5. 
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B.  DIFFICULTIES  WITH  IMPLEMENTING  MIL-STD-105D 

In  addition  to  the  details  covered  in  the  previous 
section,  there  remain  several  problems  which  must  be 
overcome  prior  to  the  implementation  of  MIL-STD-105D  for 
this  application. 

The  first  problem  investigated  is  the  level  of 
training  required  to  allow  MIL-STD-105D  to  be  used  on  a 
daily  basis.  In  order  to  properly  implement  the  standard 
and  execute  the  sampling  plan,  QA  supervisory  personnel 
will  need  to  become  familiar  with  the  mechanics  of  the 
standard:  how  to  determine  the  sample  size;  how  to 
generate  random  samples;  when  to  shift  from  one 
inspection  level  to  another;  how  to  determine  whether  a 
given  lot  is  accepted  or  rejected;  when  to  hold  the 
contractor  in  default;  even  which  of  the  tables  in  MIL- 
STD-105D  needs  to  be  used  for  each  of  these  processes. 
Given  the  atmosphere  of  litigation  which  currently 
surrounds  Commercial  Activities  contracts  at  other  Naval 
facilities,  a  fairly  high  level  of  competence  in  each  of 
these  fields  is  necessary. 

C.  IMPLEMENTATION  CONSIDERATIONS 

From  the  preceding  discussion,  we  can  see  that  there 
are  several  considerations   regarding  the   implementation 
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of   MIL-STD-105D  for  use  by  NARDAC  to  monitor   contractor 
performance . 

With  the  number  of  samples  discussed  previously  being 
generated  every  day,  it  becomes  apparent  that  our  system 
must  be  capable  of  handling  large  volumes  of  data. 
Furthermore,  since  our  hypothetical  contractor  isn't  paid 
until  QA  personnel  evaluate  his  performance,  he  may  not 
tolerate  long  delays  in  the  evaluation  process.  Indeed, 
the  NARDAC  management  and  their  superiors  may  want  fairly 
rapid  resolution  of  the  QA  question  on  an  on-going  basis. 
Since  the  inspector's  reports  become  part  of  a  record 
base  which  can  have  future  legal  ramifications,  the 
system  must  keep  track  of  a  large  number  of  records  and 
be  able  to  access  them  rapidly.  From  the  preceding 
discussion  of  the  mechanics  of  MIL-STD-105D,  it  is 
evident  that  the  system  must  be  not  only  adaptable,  but 
must  handle  the  changing  circumstances  occasioned  by  a 
shift  in  inspection  level  quickly  and  accurately. 
Finally,  the  implementation  must  be  secure  from  unautho- 
rized access  by  any  person  who  may  be  connected  with  the 
contractor.  This  is  due  to  the  fact  that  information 
regarding  which  samples  are  to  be  drawn  for  inspection  is 
extremely  sensitive.  Should  an  unscrupulous  contractor 
gain  access  to  this  information,  it  is  not  inconceivable 
that  he  could,   in  some  manner,   alter  the  record  numbers 
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and  submit  jobs  for  inspection  which  he  had  previously 
checked  himself  to  ensure  their  correctness  and 
timeliness.  This  would  of  course,  defeat  the  purpose  of 
the  random  sampling  process,  as  only  those  jobs  he  knew 
to  be  perfect  would  ever  be  examined. 

The  preceding  discussion  suggests  that  some  form  of 
automated  implementation  may  improve  the  accuracy  with 
which  MIL-STD-10  5D  is  implemented,  as  well  as  aid  in  the 
retrievability  of  the  information  stored. 

D.   FACILITIES   FOR  AUTOMATED  IMPLEMENTATION  OF   MIL-STD- 
105D 

The   existing   ADP   facilities   at   a   regional   data 

processing   center  would  at  first  glance  appear  to   offer 

almost    unlimited     resources    for     an    automated 

implementation   of   the   project.    It   is   important   to 

remember  that  the  bulk  of  ADP  equipment  and  programs  will 

be  under  the  direct  control  of  the   contractor,   however, 

and   as  such  the  opportunities  for  breaching  the  security 

of  the  quality  assurance  system  are  legion.  There  remains 

a   mainframe  computer  (which  will  remain   under   military 

control   even   in   the  event  of  NARDAC   operations   being 

placed   under  civilian  contract)  and  several   stand-alone 

microcomputers . 
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There  are  many  advantages  to  using  the  mainframe  over 
the  microcomputer  execution  speed,  CPU  power,  file 
capacity  and  system  reliability  to  name  only  the  most 
obvious.  Unfortunately,  a  security  problem  remains.  While 
the  mainframe  under  discussion  remains  under  military 
control  and  is  physically  separate  from  the  ADP 
facilities  which  would  be  under  the  contractor's  control, 
it  can  be  electronically  linked  to  that  equipment  using 
existing  telecommunications  procedures.  This  opens  the 
possibility  of  an  unscrupulous  contractor  using  this 
telecommunications  capability  to  effect  the  system 
compromise  previously  discussed. 

The  microcomputers  currently  available  at  NARDAC  are 
standard  Z-80  based,  8-bit  machines  with  64  kilobytes  of 
internal  random  access  memory.  The  machines  are  of 
normal  commercial  manufacture.  Most  feature  two  384  kilo- 
byte 5  1/4  inch  floppy  minidisk  drives  for  secondary 
storage.  There  is  a  library  of  bundled  software  which 
accompanies  each  machine,  as  well  as  some  add-on  software 
packages  the  command  has  purchased.  Included  among  these 
is  dBASE  II ,  a  well  known  relational  database  management 
system  for  microcomputers  from  Ashton-Tate  Software. 
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E.  IMPLEMENTATION  SUMMARY 

To  summarize  the  implementation  strategy  thus  far,  the 
decisions  have  been  made  to: 

1 .  Define  a  lot  as  the  output  of  the  center  for  one 
day,  from  0000  to  2359,  local  time. 

2.  Conduct  single  inspection  of  samples. 

3.  Utilize  General  Inspection  Level  II. 

4.  Investigate  the  possibilities  of  implementing  MIL- 
STD-105D  on  the  command's  microcomputers,  utilizing 
the  database  management  system  (DBMS)  dBASE  II . 
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IV. PROJECT  SPECIFICATIONS 

A.  NARDAC  REQUIREMENTS 

Specific  requirements  for  implementing  MIL-STD-105D 
were  defined  during  a  series  of  discussions  with  NARDAC 
personnel.  These  requirements  tended  to  center  about 
input  and  output  specifications/  questions  regarding 
random  number  generation,  and  overall  project 
feasibility.  NARDAC 's  system  specifications  are 
summarized  below: 

1.  The  system  as  implemented  must  generate  its  own 
random  numbers  for  sample  selection.  As  a  corollary  to 
this  requirement,  it  was  mutually  decided  upon  that 
there  would  be  no  transparent  "seed"  or  starting  point 
to  be  input  which  would  be  subject  to  manipulation.  A 
secret  or  hidden  seed  was  deemed  acceptable.  The 
random  numbers  are  to  be  used  to  notify  which  jobs  are 
to  be  inspected. 

2.  The  system  must  store  the  results  of  the  inspection 
process  for  future  use.  Storage  on  floppy  disk  was 
judged  to  be  satisfactory  for  this  requirement. 
Furthermore,  data  stored  on  the  disks  must  be 
available  in  a  variety  of  formats,  not  all  of  which 
are  presently  known. 
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3.  The  system  inself  must  be  adaptable  to  future 
change  without  undue  difficulty  in  reprogramming 
effort.  For  instance,  as  new  formats  for  data  become 
known,  the  system  should  be  capable  of  responding  with 
modular  output  formats  with  little  system 
perturbation.  Other  contemplated  changes  in  the  system 
will  be  discussed  later  in  this  work. 

4.  The  system  must  be  usable  by  individuals  not 
necessarily  computer  literate,  or  at  least  be  usable 
with  a  minimum  of  training.  The  system  must 
communicate  with  the  users  in  plain  English,  not 
"computerese" . 

5.  In  its  initial  form  the  system  must  generate  report 
forms  for  the  quality  assurance  inspectors  to  fill  out 
for  each  job  to  be  sampled.  There  are  two  such  forms, 
one  for  the  inspection  of  the  job's  timeliness  and 
one  for  the  job's  quality.  The  timeliness  report  is 
used  for  every  job,  while  the  quality  report  is  used 
for  those  jobs  having  actual  physical  output.  When  the 
system  is  fully  implemented,  it  is  anticipated  that 
pre-printed  report  forms  will  be  obtained  and  the 
only  input  to  them  will  be  the  sample  identification. 

6.  The  jobs  selected  for  sampling  will  be  identified 
by    a   composite   identification   number   called    an 
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Inspection  Requirement  Report  or  IRR.  The  IRR  shall 
consist  of  the  Julian  date  the  job  was  completed  in 
the  format  YYDDD  (January  20,  1984  would  therefore  be 
84020),  the  local  time  the  job  was  completed  in 
twenty-four  hour  notation  and  the  job's  record  number, 
for  instance:  84020  1345  34876 

7.  The  system  must  be  able  to  input  inspection  results 
from  any  day  previously  specified. 

8.  The  system  must  analyze  the  results  of  the 
inspection  process  in  accordance  with  MIL-STD-105D  and 
make  available  the  following  information: 

(A) .   The   inspection   level   recommended   for   the 
current  day's  inspection  plan, 

(B).  The  random  samples  to  be  inspected, 

(C).   Whether   to  accept  or  reject  the  contractor's 
efforts  for  the  day  in  question,  and 

(D).   The  inspection  level  recommended  for  the  next 
day's  efforts. 

9.  Should  the  contractor's  efforts  be  rejected,  the 
system  must  conduct  deduct  analysis  to  determine  the 
amount  to  be  deducted  from  his  compensation  for  the 
day   in   question.   In  the  event   the   contractor  has 
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failed  ten  successive  days  in  tightened  inspection, 
the  system  should  notify  QA  personnel  that  inspection 
is  to  be  discontinued  in  accordance  with  MIL-STD-105D 
and  that  the  contractor  is  in  default. 

This  analysis  should  include  all  elements  of  MIL-STD- 
105D  given  the  decisions  summarized  in  Chapter  III, 
Section  E  of  this  thesis. 

B.  ADDITIONAL  REQUIREMENTS 

In  response  to  some  of  the  requirements  specified  by 
NARDAC  in  the  preceding  section,  and  as  coding  of  the 
project  progressed,  some  additional  system  requirements 
became  known. 

1.  Design  of  the  program  must  be  modular  in  order  to 
allow  for  system  maintenance  and  modification. 

2.  The  system  must  be  menu-driven  to  allow  operation 
by  personnel  who  are  not  familiar  with  it's 
programming. 

3.  Since  the  lot  size  is  determined  by  the  size  of  one 
day's  output,  the  date,  expressed  in  Julian  terms, 
will  be  a  major  system  key,  whereby  several  decisions 
are  made  during  system  operation.  In  this  sense,  the 
system  can  be  said  to  be  "date-driven". 
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4 .  Security  is  to  be  effected  by  the  use  of  stand- 
alone microcomputers,  whose  only  connection  with  the 
contractor  will  be  via  modems;  such  connection  is  to 
be  completed  only  by  QA  personnel  and  terminated 
immediately  upon  receipt  of  the  desired  information 
(lot  size  and  record  identification  numbers).  Since 
these  microcomputers  at  NARDAC  San  Francisco  can  be 
made  physically  secure,  and  access  to  them  and  their 
software  limited  to  authorized  personnel,  it  may  be 
assumed  that  they  exist  in  a  benign  environment. 

5.  The  total  day's  run  for  each  day  would  not  reside 
in  microcomputer  files;  rather,  such  files  will 
contain  only  those  samples  selected  for  inspection  and 
the  results  of  the  inspection  process. 
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V.  SYSTEM  DESIGN 
A.  DESIGN  METHODOLOGY 

The  basic  design  methodology  used  in  the  design  of  the 
system  was  the  modified  version  of  stepwise  refinement 
(or  top-down  design)  described  by  Sommerville  [Ref.  9: 
pp.  38-77].  Briefly,  the  steps  included: 

1.  Study  and  understanding  of  the  problem, 

2.  Identification  of  the  gross  features  of  at  least 
one  possible  solution,  with  no  consideration  of  low- 
level  implementation  details, 

3.  Construction  of  a  data  flow  diagram  showing  gross 
data  transformations  in  the  system, 

4.  Construction  of  structure  charts  showing  the 
program  units  involved  in  the  solution,  and 

5.  Modular  implementation  of  the  program  units  in  the 
programming  language. 

Following  the  notational  system  presented  by  Modes  [Ref. 
10],  data-flow  diagrams  and  structure  charts  were 
combined  as  one  unit  and  expanded  as  necessary  to  achieve 
clarity  of  design.  After  validation  and  verification  of 
system  feasibility,  program  coding  in  the  programming 
language  began. 
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B.  DESIGN  RESULTS,  SYSTEM  OVERVIEW 

The  data-flow  diagrams  for  the  system  are  presented  in 
Appendix  B.  The  system  overview  is  shown  as  Figure  1.  The 
results  are  summarized  below  and  will  be  discussed  in 
detail  in  the  sections  dealing  with  the  first  expansion 
of  the  system  design.  At  this  point  in  the  design  phase 
the  system  was  named  the  Automated  Quality  Assurance 
System  (AQAS) . 

1 .  Examination   of   the   system   overview   shows   the 
following  system  inputs: 

(A).  Date.   Date   is   entered   in   the   Julian 
notation  previously  described. 

(B).  System  Commands.   There  are  several  of  these, 
defining   the   systems   operation. 

(C).   Sample   Information.   Information   needed   to 
compute  the  random  samples. 

(D).  Sample   Designation   and  Inspection   Results. 
From  the  Input  module. 

2.  The  following  system  outputs  are  generated. 

(A).  Menu   messages,   notifying  the  user  of  system 
actions  enabling  the  user  to  input  needed   informa- 
tion and  to  output  results. 
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(B).  Sample   list,   a   listing  of  the  jobs   to   be 
inspected . 

(C).  Timeliness  Report  Forms,  one  per  job. 

(D).  Quality  Report  Forms,  one  per  job  where  there 
is  actual  physical  output. 

(E).  Error  messages  as  needed. 

(F).  Inspection  results  as  either  a  current  status 
report,  or  a  termination  report. 

C.  DESIGN  RESULTS,  FIRST  EXPANSION 

The  first  design  expansion  of  the  Automated  Quality 
Assurance  System  (Appendix  B,  Figure  2)  shows  the  inter- 
relationships between  the  principal  system  modules  and 
their  major  inputs  and  outputs.  The  principal  system 
modules  are  Main,  Select,  Input ,  Analyze ,  and  Utility 
with  the  Main  module  the  central  module  of  the  system, 
from  which  all  subordinate  modules  depend. 

The  Main  module  (or  Main  Menu)  [Fig.  2]  is  automati- 
cally called  from  Sinon  (itself  automatically  called  when 
initializing  the  system) .  Sinon  is  nothing  more  than  a 
welcome  screen.  Main  is  the  module  which  calls  the  other 
modules  and  to  which  they  default  upon  completion  of 
their   tasks.   Note   that  in  each  case,   the   subordinate 
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modules  are  called  by  a  simple  command,  with  no  memory 
variables  being  used.  This  is  to  preserve  the  modularity 
of  the  system  and  to  increase  system  flexibility  in  terms 
of  dealing  with  more  than  one  date  per  subordinate  module 
call.  The  date  is  a  major  system  delimiter,  as  will  be 
seen  shortly. 

Select  [Fig.  2]  is,  in  many  respects,  the  "heart"  of 
AQAS .  It  is  here  that  the  entire  problem  of  random  number 
generation  and  sample  selection  is  solved.  Seen  for  the 
first  time  in  Select  is  Set juln,  the  module  which  allows 
input  of  the  date  in  question.  Set juln  will  be  seen  in 
several  modules  as  the  program  develops.  After  the  user 
defines  the  date  with  Set juln,  Select  informs  him  of  the 
recommended  inspection  level  (Rcmdinsp) ,  asks  him  for  the 
number  of  events  (in  this  discussion,  events  equate  to 
jobs)  and  finally,  what  inspection  level  is  to  be  used. 
Note  that  the  system  does  not  mandate  the  inspection 
level  for  the  day,  since  the  shift  to  reduced  inspection 
is  both  a  function  of  MIL-STD-105D  and  management  option. 
After  receipt  of  this  information,  Select  calls  Sampgen 
which  states  the  number  of  samples  to  be  taken  in 
accordance  with  MIL-STD-105D  and  stores  this  information 
to  a  memory  variable.  Select  then  calls  Randgen  to 
generate  "random"  numbers.  The  numbers  generated  are 
actually   pseudorandom   in   that  there  is   an   arithmetic 
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algorithm  which  produces  them  from  a  hidden  value,  or 
seed  [Ref.  11:  pp.  184].  Randgen  then  compares  the  random 
number  generated  with  the  number  of  events  to  determine 
the  event  number  to  be  inspected.  Randgen  ensures  that 
the  event  number  is  unique  before  storing  it  to  a  data- 
base file.  After  Randgen  has  completed  this  cycle  as  many 
times  as  there  are  samples  to  be  taken,  it  returns  to 
Select.  Select  then  calls  Notify  which  indexes  the  event 
numbers  (puts  them  in  numerical  order)  and  prints  a  list 
giving  the  day's  Julian  date  and  a  list  of  the  event 
numbers  to  be  sampled.  Notify  returns  to  Select,  which  in 
turn  returns  to  Main . 

The  next  module  normally  called  by  the  user  would  be 
Input  [Fig.  4].  Input  has  two  functions:  to  input  to  a 
database  file  all  the  events  selected  for  inspection, 
then  in  a  separate  action,  to  input  the  results  of  the 
inspection  process.  This  is  accomplished  first  by  calling 
a  subordinate  module  called  Sampspec  which  accomplishes 
the  first  action,  then  when  all  samples  have  been  entered 
for  the  specified  day,  the  user  may  opt  to  input 
inspection  results.  This  is  accomplished  through  the 
Inspres  module  which  allows  the  user  to  define  the  sample 
for  which  he  is  inputting  inspection  results,  then 
allows  the  user  to  input  the  inspection  results.  The 
inspection  results  include  the  site  where  the  product  was 
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delivered,  whether  the  sample  passed  the  timeliness 
inspection  and,  if  not,  whether  this  was  the  result  of  a 
failure  of  the  computer  system  or  of  the  government, 
whether  the  sample  passed  the  quality  inspection  and,  if 
not,  was  the  problem  one  of  accuracy  of  results  or  of 
print  quality.  When  the  user  has  completed  his  input 
actions,  he  returns  to  Main .  Note  that  in  each  of  these 
modules,  it  is  possible  to  specify  the  date  with  Set juln. 

The  next  module  is  the  sequence  is  the  Analyze  module 
[Fig  5.]  which  takes  data  previously  input,  and  analyzes 
it.  The  first  thing  this  module  does  upon  execution  is  to 
run  a  version  of  Set juln  called  Analyze . Fmt .  Analyze . Fmt 
performs  the  same  functions  as  Set juln ,  but  also  displays 
a  message  to  the  user  regarding  system  operation  at  this 
time.  After  getting  the  date  to  be  analyzed  from  the 
user,  Analyze  automatically  steps  through  several  subord- 
inate modules.  The  first  of  these  is  Sampchek  which 
ensures  that  all  samples  for  the  specified  date  have  been 
entered.  It  then  checks  to  ensure  that  all  reports  for 
all  samples  have  been  entered.  If  either  a  sample  or  a 
report  has  been  omitted,  Sampchek  displays  an  error 
message  and  returns  the  user  to  Input  to  input  the 
missing  information.  Assuming  that  there  is  no  missing 
data,  the  next  module  from  Analyze  is  Sampanal  which 
determines   whether  to  accept  or  reject  the   contractor's 
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efforts  for  the  day  in  question  in  accordance  with  MIL- 
STD-105D.  In  addition  to  making  this  determination,  the 
system  also  determines  the  recommended  inspection  level 
for  the  next  day  in  the  case  where  the  current  day's 
inspection  was  conducted  under  the  reduced  inspection 
level.  This  is  done  at  this  time  because  only  at  the 
reduced  inspection  level  does  the  possibility  exist  for 
both  the  lot  to  be  accepted,  and  the  inspection  level  to 
become  more  stringent,  i.e.:  go  from  reduced  to  normal. 
Because  this  decision  is  based  on  the  number  of  samples 
failing  inspection  it  is  logical  to  place  this  determ- 
ination at  this  location. 

After  Sampanal  has  completed  and  returned  to  Analyze , 
that  module  calls  Inspanal .  Inspanal  's  purpose  is  to 
determine  the  recommended  inspection  level  in  the  cases 
where  the  current  day's  inspection  was  conducted  in  the 
normal  or  tightened  mode.  This  is  not  done  in  the  same 
manner  as  this  same  determination  for  the  reduced 
inspection  just  discussed  because  its  operation  under 
MIL-STD-105D  is  different  and  to  include  this  relatively 
lengthy  step  for  each  case  in  Sampanal  would  make  for  a 
very  inefficient  program.  Inspanal  performs  the  same 
functional  task,  however,  returning  a  value  for  the 
recommended  inspection  level  for  the  next  day's 
inspection  efforts.   After  completing  this  task,   it   too 
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returns  to  Analyze,  which  now  calls  Insprpt .  Insprpt  's 
sole  function  is  to  output  one  of  two  messages:  Statrpt 
reports  to  the  user  the  date  just  analyzed,  the  number  of 
samples,  the  number  of  samples  failing  inspection,  the 
number  of  jobs  processed  by  the  contractor,  what  the 
experienced  failure  rate  is,  what  the  results  of  the 
inspection  were  (accepted  or  rejected),  and  the  recommen- 
ded level  for  the  next  day's  inspection  efforts.  Termrpt 
notifies  QA  personnel  that  samples  from  ten  previous  days 
have  failed  inspection,  and  that  sampling  should  be 
stopped  and  the  contract  terminated. 

The  last  module  to  be  discussed  is  the  Utility  module 
[Fig.  6],  which  currently  consists  solely  of  a  program 
stub,  as  the  exact  format  of  additional  reports  is 
unknown.  Utility  provides  expansion  space  to  allow  for 
the  development  of  custom  reports. 


44 


VI.  SYSTEM  CODING 

A.  INTRODUCTION  TO  dBASE  II 

dBASE  II  is  a  relational  database  management  system 
for  microcomputers.  Originally  developed  as  VULCAN  by 
Wayne  Ratliff  at  Caltech's  Jet  Propulsion  Laboratory,  the 
system  is  currently  marketed  commercially  by  Ashton-Tate. 
dBASE  II  requires  the  following  hardware  and  software 
configuration : 

1.  8080/  8085,  or  Z-80  based  microprocessor  system 
equipped  with  CP/M,  CDOS ,  or  CROMIX  operating  systems 
or  8086  or  8088  based  microprocessor  system  equipped 
with  CP/M-86  or  MSDOS  operating  systems. 

2.  48  kilobytes  of  memory  (RAM). 

3.  One  or  more  mass  storage  devices  (minidisks,  etc). 

4.  A  cursor-addressable  CRT  for  full  screen  oper- 
ations . 

5.  For  some  applications  (including  AQAS ) ,  a  text 
printer  is  required. 

B.  dBASE  H  AS  A  PROGRAMMING  LANGUAGE 

dBASE  II  presents  some  aspects  of  both  procedural  and 
non-procedural   languages  in  that  it  supports   structured 
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programming,  while  at  the  same  time  allowing  unstructured 
programming  practices.  This  is  a  mixed  blessing  as  it 
tends  to  allow  marginal  programs  to  run  acceptably,  while 
preventing  the  benefits  in  error  correction  that  true 
structured  programming  possesses.  If  good  programming 
practices  are  followed,  however,  it  does  support  struc- 
tured, modular  programming.  Aside  from  some  limitations 
on  file,  record,  field  and  string  length  it  is  a  powerful 
database  management  system  (DBMS).  There  are  four 
disadvantages  to  its  use,  however.  In  no  way  could  one 
consider  dBASE  II  to  be  a  real-time  system.  In  the  NARDAC 
implementation  (Morrow  MD-3  microcomputers)  the  average 
time  required  to  generate  200  samples  for  10,000  events 
was  two  and  one  half  minutes.  Secondly,  it  supports  only 
very  elementary  mathematics.  This  presented  a  limitation 
to  the  implementation  of  AQAS  in  that  many  of  the  pseudo- 
random number  generators  rely  heavily  on  the  use  of 
logarithms.  Third,  the  documentation  for  dBASE  II  is 
poor,  at  best.  Massive  in  scope,  it  still  fails  to 
present  all  the  power  of  the  language.  The  system  manual 
[Ref.  12]  accompanying  the  software  appears  to  be  written 
for  someone  who  is  thoroughly  conversant  with  the 
language  and  has  no  need  for  the  documentation.  Ashton- 
Tate seems  to  be  relying  on  after-market  documentation  to 
explain  the  system  to  its  users  [Refs.  13  and  14]. 
Finally,     customer    support    from    Ashton-Tate    was 
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insufficient,  consisting  of  advice  to  purchase  an  after- 
market  tutorial  to  explain  the  system  to  the  programmer 
[Ref.  14].  These  considerations  notwithstanding,  dBASE  II 
proved  adequate  for  the  implementation  of  AQAS . 

C.  CODING  AQAS 

The  actual  task  of  programming  the  Automated  Quality 
Assurance  System  went  smoothly.  The  entire  system  code  is 
included  as  Appendix  C.  There  follow  some  remarks 
regarding  matters  which  arose  during  the  course  of 
programming. 

One  of  the  difficulties  encountered  was  in  ensuring 
that  the  random  numbers  generated  in  Randgen  were  unique. 
For  instance,  given  a  lot  size  of  4  and  a  sample  size  of 
2,  a  program  which  calls  for  inspecting  item  3  twice  is 
not  functioning  properly.  Ensuring  that  the  program 
would  not  do  this  took  considerable  effort. 

Another  feature  that  took  a  considerable  effort  to 
effect  was  the  inclusion  of  a  memory  variable  in  a  report 
form.  REPORT  is  a  function  of  dBASE  II  which  allows  for 
the  output  of  database  information  in  a  pre-specif ied 
format.  This  was  one  area  where  Ashton-Tate  's  poor 
documentation  and  poorer  customer  service  were 
particularly   irksome.   Neither   the   system   manual   nor 
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repeated  telephone  calls  to  Ashton-Tate  resolved  this 
relatively  simple  matter.  The  final  solution  to  the 
problem  was  provided  by  NARDAC  personnel. 

While  the  benefits  of  a  menu-driven  system  for  non- 
technical users  are  evident,  the  fairly  slow  nature  of 
the  input  process  using  a  menu  system  is  annoying.  While 
there  exists  no  easy  solution  for  this  problem,  this  is 
one  area  in  AQAS  that  would  benefit  from  further  study. 
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VII.  EVALUATION 

A.  CONCLUSIONS 

AQAS  was  successfully  implemented  using  the  methodo- 
logy, equipment,  and  software  described  previously.  The 
design  allows  the  quality  assurance  administrator  to 
utilize  MIL-STD-105D  on  a  continuing  basis  with  no  fear 
of  making  mistakes  in  implementation,  at  the  same  time 
permitting  any  user  to  generate  random  samples,  input 
data  and  analyze  results. 

Although  this  system  was  tailored  to  the  application 
peculiar  to  NARDAC,  San  Francisco,  it  remains  applicable 
to  other  NARDACS  contemplating  converting  operations  to 
commercial  service  contracts  under  OMB  Circular  No.  A-76. 
Furthermore,  it  remains  in  essence  nothing  but  an 
automated  form  of  MIL-STD-105D  with  input  and  report 
generation  capabilities  tailored  to  a  specific  applica- 
tion. As  such,  given  its  modular  design  and  documenta- 
tion, it  should  be  reasonably  easy  to  convert  to  other 
applications  requiring  statistical  quality  control 
utilizing  MIL-STD-105D. 

B.  RECOMMENDATIONS 

As  with  any  software  project,  the  software  designer 
can  always  find  modifications  and  enhancements  he  would 
like  to  implement,   and  AQAS  is  no  exception.   The  system 
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needs  more  error  handling  routines;  the  option  should 
exist  for  the  user  to  exit  from  the  menu  driven  input 
mode  and  input  results  more  directly  in  order  to 
facilitate  the  input  process;  and  the  utility  programs 
need  to  be  defined  and  effected.  To  the  end  users  are 
left  these  exercises. 

C.  NOTES  TO  USERS 

1.  The  format  FILENAME.CMD  is  used  when  dBASE  II  is 
implemented  on  a  microcomputer  using  the  CP/M  operating 
system.  For  users  wishing  to  utilize  16  bit  architectures 
the  format  is  FILENAME. PRG. 

2.  The  random  number  generator  found  in  Randgen  has  been 
modified  somewhat  from  its  presentation  in  this  work  to 
preclude  its  access  by  unauthorized  personnel.  While  the 
function  remains  the  same,  a  "confuser"  has  been  added  so 
that  the  values  of  seed  are  not  so  straightforward  as 
appear  here. 

3.  The  CP/M  operating  system  as  modified  by  Morrow  for 
use  in  their  MD3  microcomputers  allows  for  over  120 
dictionary  entries,  far  more  than  the  64  entries  allowed 
by  unmodified  versions  of  CP/M.  End  users  may  need  to 
either   modify  similarly  their  versions  of  CP/M  or   merge 
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some   of   the   files  in  AQAS  to  enable  their   systems   to 
accept  its  several  modules. 

4.    As    this   program   was   developed   for   NARDAC   San 

Francisco,  inquiries  regarding  AQAS  implementation  may  be 

addressed  to  : 

Commanding  Officer 
NARDAC  San  Francisco 
Building  8-1,  Code  50X 
NAS  Alameda,  CA   94  501 

Attn:  Mr.  Al  Hinds 
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SAMPLING  PROCEDURES  AND  TABLES 
FOR  INSPECTION  BY  ATTRIBUTES 


«x£*a*» 


1.     SCOPE 


*.l  PURPOSE.  This  publication  estab- 
lishes sampling  plans  and  procedures  for 
inspection  by  attributes.  When  specified  by 
the  responsible  authority,  this  publication 
shall  be  referenced  in  the  specification,  con- 
tract, inspection  instructions,  or  other  docu- 
ments and  the  provisions  set  forth  herein 
shall  govern.  The  "responsible  authority" 
shall  be  designated  in  one  of  the  above 
documents. 

1.2  APPLICATION.  Sampling  plans  des- 
ignated in  this  publication  are  applicable,  but 
not  limited,  to  inspection  of  the  following: 

a.  End   items. 

b.  Components  and   raw  materials. 

c.  Operations. 

d.  Materials  in   process. 

e.  Supplies  in  storage. 

f.  Maintenance  operations. 

g.  Data  or  records. 

h.     Administrative  procedures. 

T^.ese   plans   are   intended   primarily   to   be 
used  for  a  continuing  series  of  lots  or  batches. 


The  plans  may  also  be  used  for  the  inspection 
of  isolated  lots  or  batches,  but,  in  this  latter 
case,  the  user  is  cautioned  to  consult  the 
operating  characteristic  curves  to  find  a  plan 
which  will  yield  the  desired  protection  (see 
11.6). 

1 .3  INSPECTION.  Inspection  is  the  proc- 
ess of  measuring,  examining,  testing,  or 
otherwise  comparing  the  unit  of  product  (see 
1.5)  with  the  requirements. 

1.4  INSPECTION  BY  ATTRIBUTES.  In- 
spection by  attributes  is  inspection  whereby 
either  the  unit  of  product  is  classified  simply 
as  defective  or  nondefective,  or  the  number 
of  defects  in  the  unit  of  product  is  counted, 
with  respect  to  a  given  requirement  or  set 
of  requirements. 

1.5  UNIT  OF  PRODUCT.  The  unit  of 
product  is  the  thing  inspected  in  order  to 
determine  its  classification  as  defective  or 
nondefective  or  to  count  the  number  of  de- 
fects. It  may  be  a  single  article,  a  pair,  a  set, 
a  length,  an  area,  an  operation,  a  volume,  a 
component  of  an  end  product,  or  the  end 
product  itself.  The  unit  of  product  may  or 
may  not  be  the  same  as  the  unit  of  purchase, 
supply,  production,  or  shipment. 
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2.      CLASSIFICATION   OF   DEFECTS   AND   DEFECTIVES 


2.1      METHOD  OF  CLASSIFYING  DEFECTS. 

A  classification  of  defects  is  the  enumeration 
of  possible  defects  of  the  unit  of  product 
classified  according  to  their  seriousness.  A 
defect  is  any  nonconformance  of  the  unit  of 
product  with  specified  requirements.  Defects 
will  normally  be  grouped  into  one  or  more 
of  the  following  classes;  however,  defects 
may  be  grouped  into  other  classes,  or  into 
subclasses  within  these  classes. 

2.1.1  CRITICAL  DEFECT.  A  critical  de- 
fect is  a  defect  tha  judgment  and  experience 
indicate  is- likely  to  result  in  hazardous  or 
unsafe  conditions  for  individuals  using, 
maintaining,  or  depending  upon  the  product; 
or  a  defect  that  judgment  and  experience 
indicate  is  likely  to  prevent  performance  of 
the  tactical  function  of  a  major  end  item  such 
as  a  ship,  aircraft,  tank,  missile  or  space 
vehicle.  NOTE:  For  a  special  provision  re- 
lating to  critical  defects,  see  6.3. 

2.1.2  MAJOR  DEFECT.  A  major  defect 
is  a  defect,  other  than  critical,  that  is  likely 
to  result  in  failure,  or  to  reduce  materially 
the  usability  of  the  unit  of  product  for  its 
intended   purpose. 


2.1.3  MINOR  DEFECT.  A  minor  defect 
is  a  defect  that  is  not  likely  to  reduce  ma- 
terially the  usability  of  the  unit  of  product 
for  its  intended  purpose,  or  is  a  departure 
from  established  standards  having  little  bear- 
ing on  the  effective  use  or  operation  of  the 
unit. 

2.2  METHOD  OF  CLASSIFYING  DEFEC- 
TIVES. A  defective  is  a  unit  of  product  which 
contains  one  or  more  defects.  Defectives  will 
usually  be  classified  as  follows: 

2.2.1  CRITICAL  DEFECTIVE.  A  critical 
defective  contains  one  or  more  critical  de- 
fects and  may  also  contain  major  and  or 
minor  defects.  NOTE:  For  a  special  provi- 
sion relating  to  critical  defectives,  see  6.3. 

2.2.2  MAJOR  DEFECTIVE.  A  major  de- 
fective contains  one  or  more  major  defects, 
and  may  also  contain  minor  defects  but  con- 
tains no  critical  defect. 

2.2.3  MINOR  DEFECTIVE.  A  minor  de- 
fective contains  one  or  more  minor  defects 
but  contains  no  critical  or  major  defect. 


PERCENT   DEFECTIVE   AND    DEFECTS   PER   HUNDRED   UNITS 


3.1  EXPRESSION  OF  NONCONFORM- 
ANCE. The  extent  of  nonconformance  of 
product  shall  be  expressed  either  in  terms 
of  percent  defective  or  in  terms  of  defects  per 
hundred  units. 

3.2  PERCENT  DEFECTIVE.  The  percent 
defective  of  any  given  quantity  of  units  of 
product  is  one  hunderd  times  the  number  of 
defective  units  of  product  contained  therein 
divided  by  the  total  number  of  units  of  pro i- 
uct,  i.e.: 


Percent  defective    = 


Number   of  defectives 
Number  of  units   inspected 


100 


3.3      DEFECTS  PER  HUNDRED  UNITS.    The 

number  of  defects  per  hundred  units  of  Any 
given  quantity  of  units  of  product  is  one 
hundred  times  the  number  of  defects  con- 
tained therein  (one  or  more  defects  being 
possible  in  any  unit  of  product)  divided  by 
the  total  number  of  units  of  product,  i.e.: 


Detects  per 
hundred   units 


Number  of  defects 

Number  of   units  inspectc-a 


*    100 
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4.      ACCEPTABLE   QUALITY    LEVEL  (AQL) 


4.1  USE.  The  AQL,  together  with  the 
Sample  Size  Code  Letter,  is  used  for  index- 
ing the  sampling  plans  provided  herein. 

4.2  DEFINITION.  The  AQL  is  the  max- 
imum percent  defective  (or  the  maximum 
number  of  defects  per  hundred  units)  that, 
for  purposes  of  sampling  inspection,  can  be 
considered  satisfactory  as  a  process  average 
(see   11.2). 

4.3  NOTE   ON   THE   MEANING   OF   AQL. 

When  a  consumer  designates  some  specific 
value  of  AQL  for  a  certain  defect  or  group 
cf  defects,  he  indicates  to  the  supplier  that 
his  (the  consumer's)  acceptance  sampling 
plan  will  accept  the  great  majority  of  ihe  lots 
or  batches  that  the  supplier  submits,  pro- 
vided the  process  average  level  of  percent 
defective  (or  defects  per  hundred  units)  in 
these  lots  or  batches  be  no  greater  than  the 
designated  value  of  AQL  Thus,  the  AQL 
is  a  designated  value  of  percent  defective  (or 
deiects  per  hundred  units)  that  the  consumer 
indicates  will  be  accepted  most  of  the  time 
by  the  acceptance  sampling  procedure  to  be 
used.  The  sampling  plans  provided  herein 
are  so  arranged  that  the  probability  of  ac- 
ceptance at  the  designated  AQL  value  de- 
pends upen  the  sample  size,  being  generally 
higher  for  large  samples  than  for  small  ones, 
for  a  given  AQL.    The  AQL  alone  does  not 


describe  the  protection  to  the  consumer  for 
individual  lots  or  batches  but  mure  directly 
relates  to  what  might  be  expected  from  a 
series  of  lots  or  batches,  provided  the  steps 
indicated  in  this  publication  are  taken  It  is 
necessary  to  refer  to  the  operating  character- 
istic curve  of  the  plan,  to  determine  what 
protection  the  consumer  will  have. 

4.4  LIMITATION.      The  designation  of  an 

AQL  shall  not  imply  that  the  supplier  has 
the  right  to  supply  knowingly  any  defective 
unit   of  pi'oduct 

4.5  SPECIFYING  AQLs.  The  AQL  to  be 
used  will  be  designated  in  the  contract  or  by 
the  responsible  authority  Different  AQLs 
may  be  designated  for  groups  of  defects  con- 
sidered collectively,  or  for  individual  defects. 
An  AQL  for  a  group  of  defects  may  be  des- 
ignated in  addition  to  AQLs  for  individual 
defects,  or  subgroups,  within  that  group 
AQL  values  of  10.0  or  less  may  be  expressed 
either  in  percent  defective  or  in  defects  per 
hundred  units;  those  over  10.0  shall  be  ex- 
pressed in  defects  per  hundred  units  only 

4.6  PREFERRED  AQLs.  The  values  of 
AQLs  given  in  these  tables  are  known  as 
preferred  AQLs.  If,  for  any  product,  an  AQL 
be  designated  other  than  a  preferred  AQL, 
these  tables  are  not  applicable. 


5.      SUBMISSION   OF   PRODUCT 


5.1  LOT  OR  BATCH.  The  term  lot  or 
batch  shall  mean  "inspection  lot"  or  "inspec- 
tion batch,"  i.e.,  a  collection  of  units  of  prod- 
uct from  which  a  sample  is  to  be  drawn  and 
inspected  to  determine  conformance  with  the 
acceptability  criteria,  and  may  differ  from  a 
collection  of  units  designated  as  a  lot  or  batch 


for  other   purposes    (eg,    production,   ship- 
ment,  etc.). 

5.2  FORMATION  OF  LOTS  OR  BATCHES. 
The  product  shall  be  assembled  into  identi- 
fiable lots,  sublots,  batches,  or  in  such  other 
manner  as  may  be  prescribed  ( see  5.4)  Each 
lot  or  batch  shall,  as   far  as  is  practicable. 
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5.      SUBMISSION   OF   PRODUCT   (Continued) 


consist  of  units  of  product  of  a  single  type, 
grade,  class,  size,  and  composition,  manu- 
factured under  essentially  !he  same  condi- 
tions, and  at  essentially  the  same  time. 

5.3      LOT    OR    BATCH    SIZE.      The   lot   or 

batch  size  is  the  number  of  units  of  product 
in  a   lot  or  batch. 

54      PRESENTATION    OF    LOTS    OR 
BATCHES.      The    formation    of    the    lots    or 


batches,  lot  or  batch  size,  and  the  manner 
in  which  each  lot  or  batch  is  to  be  presented 
and  identified  by  the  supplier  shall  be  des- 
ignated or  approved  by  the  responsible  au- 
thority As  necessary,  the  supplier  shall 
provide  adequate  and  suitable  storage  space 
for  each  lot  or  batch,  equipment  needed  for 
proper  identification  and  presentation,  and 
personnel  for  all  handling  of  product  re- 
quired for  drawing  of  samples. 


ACCEPTANCE  AND  REJECTION 


6.1  ACCEPTABILITY  OF  LOTS  OR 
BATCHES.  Acceptability  of  a  lot  or  batch 
will  be  determined  by  the  use  of  a  sampling 
plan  or  plans  associated  with  the  designated 
AQL  or  AQLs. 

6.2  DEFECTIVE  UNITS.  The  right  is  re- 
served to  reject  any  unit  of  product  found 
defective  during  inspection  whether  that 
unit  of  product  forms  part  of  a  sample  or 
not,  and  whether  the  lot  or  batch  as  a  whole 
is  accepted  or  rejected.  Rejected  units  may 
be  repaired  or  corrected  and  resubmitted  for 
inspection  with  the  approval  of,  and  in  the 
manner  specified  by,  the  responsible  au- 
thority. 

6.3  SPECIAL  RESERVATION  FOR  CRITI- 
CAL DEFECTS.  The  supplier  may  be  required 
at  the  discretion  of  the  responsible  authority 
to  inspect  every  unit  of  the  lot  or  batch  for 


critical  defects.  The  right  is  reserved  to  in- 
spect every  unit  submitted  by  the  supplier  for 
critical  defects,  and  to  reject  the  lot  or  batch 
immediately,  when  a  critical  defect  is  found. 
The  right  is  reserved  also  to  sample,  for  crit- 
ical defects,  every  lot  or  batch  submitted  by 
the  supplier  and  to  reject  any  lot  or  batch 
if  a  sample  drawn  therefrom  is  found  to  con- 
tain one  or  more  critical  defects. 

6.4     RESUBMITTED    LOTS    OR    BATCHES. 

Lots  or  batches  found  unacceptable  shall  be 
resubmitted  for  reinspection  only  after  all 
units  are  re-examined  or  retested  and  all  de- 
fective units  are  removed  or  defects  cor- 
rected. The  responsible  authority  shall  deter- 
mine whether  normal  or  tightened  inspection 
shall  be  used,  and  whether  reinspection  shall 
include  all  types  or  classes  of  defects  or  for 
the  particular  types  or  classes  of  defects 
which  caused  initial  rejection. 


7.     DRAWING  OF  SAMPLES 


7.1  SAMPLE.  A  sample  consists  of  one 
or  more  units  of  product  drawn  from  a  lot  or 
batch,  tho  units  of  the  sample  being  selected 
at  random  without  regard  to  their  quality. 
The  number  of  units  of  product  in  the  sample 
is  the  sample  size. 


7.2  REPRESENTATIVE  SAMPLING.  When 
appropriate,  the  number  of  units  in  the  sam- 
ple shall  be  selected  in  proportion  to  the  size 
of  sublots  or  subbatches,  or  parts  of  the  lot  or 
batch,  identified  by  some  rational  criterion. 
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7.      DRAWING  OF  SAMPLES  (Continued) 


When  representative  sampling  is  used,  the 
units  from  each  part  of  the  lot  or  batch  shall 
be  selected  at  random. 

7.3  TIME  OF  SAMPLING.  Samples  may 
be  drawn  after  all  the  units  comprising  the 
lot  or  batch  have  been  assembled,  or  sam- 


ples may  be  drawn  during  assembly  of  the 
lot  or  batch. 

7.4  DOUBLE  OR  MULTIPLE  SAMPLING. 
When  double  or  multiple  sampling  is  to  be 
used,  each  sample  shall  be  selected  ov^r  the 
entire  lot  or  batch. 


8.      NORMAL,   TIGHTENED  AND  REDUCED  INSPECTION 


3.1  INITIATION  OF  INSPECTION.  Nor- 
mal inspection  will  be  used  at  the  start  of 
inspection  unless  otherwise  directed  by  the 
responsible  authority. 

0.2      CONTINUATION     OF     INSPECTION- 

Normal,  tightened  or  reduced  inspection 
shall  continue  unchanged  for  each  class  of 
defects  or  defectives  on  successive  lots  or 
batchs  except  where  the  switching  proce- 
dures given  below  require  change.  The 
switching  procedures  given  below  require  a 
change.  The  switching  procedures  shall  be 
applied  to  each  class  of  defects  or  -def e^tives, 
independently. 

8.3      SWITCHING    PROCEDURES. 

8.3.1  NORMAL  TO  TIGHTENED.  When 
normal  inspection  is  in  effect,  tightened  in- 
spection shall  be  instituted  when  2  out  of  5 
consecutive  lots  or  batches  have  been  re- 
jected on  original  inspection  (i.e.,  ignoring 
resubmitted  lots  or  batches  for  this  proce- 
dure). 

8.3.2  TIGHTENED  TO  NORMAL.      When 

tightened  inspection  is  in  effect,  normal  in- 
spection shall  be  instituted  wheii  5  consecu- 
tive lots  or  batches  have  been  considered 
acceptable  on  original  inspection. 

8.3.3  NORMAL  TO  REDUCED.  When 
normal  inspection  is  in  effect,  reduced  inspec- 
tion shall  be  instituted  providing  that  all  of 
the  following  conditions  are  satisfied: 


a.  The  preceding  10  lots  or  batches  (or 
more,  as  indicated  by  the  note  to  Table  VIII) 
have  been  on  normal  inspection  and  none 
has  been  rejected  on  original  inspection;  and 

b.  The  total  number  of  defectives  (or  de- 
fects) in  the  samples  from  the  preceding  10 
lots  or  batches  (or  such  other  number  as  was 
used  for  condition  "a"  above)  is  equal  to  or 
less  than  the  applicable  number  given  in 
Table  VIII.  If  double  or  multiple  sampling 
is  in  use,  all  samples  inspected  should  be  in- 
cluded, not  Mficst"  samples  only;  and 

c.  Production  is  at  a  steady  rate;  and 

d.  Reduced  inspection  is  considered  de- 
sirable by  the  responsible  authority. 

8.3.4  REDUCED  TO  NORMAL.  When  re- 
duced inspection  is  in  effect,  normal  inspec- 
tion shall  be  instituted  if  any  of  the  following 
occur  on  original  inspection: 

a.  A  lot  or  batch  is  rejected;  or 

b.  A  lot  or  batch  is  considered  acceptable 
under  the  procedures  of  10.1.4;  or 

c  Production  becomes  irregular  or  de- 
layed, or 

d.  Other  conditions  warrant  that  normal 
inspection  shall  be  instituted. 

8.4  DISCONTINUATION  OF  INSPECTION. 
In  the  evejit  that  10  consecutive  lots  or 
batches  remain  on  tightened  inspection  (or 
such  other  humber  as  may  be  designated  by 
the  responsible  authority),  inspection  under 
the  provisions  of  this  document  should  be 
discontinued  pending  action  to  improve  the 
quality  of  submitted  material. 
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9.     SAMPLING  PLANS 


9.1  SAMPLING  PLAN.  A  sampling  plan 
indicates  the  number  of  units  of  product 
from  each  lot  or  batch  which  are  to  be  in- 
spected (sample  size  or  series  of  sample 
sizes)  and  the  criteria  for  determining  the 
acceptability  of  the  lot  or  batch  (acceptance 
and  rejection  numbers). 

9.2  INSPECTION  LEVEL.  The  inspection 
level  determines  the  relationship  between 
the  lot  or  batch  size  and  the  sample  size.  The 
inspection  level  to  be  used  for  any  particular 
requirement  will  be  prescribed  by  the  re- 
SDonsibie  authority.  Three  inspection  levels: 
I,  II,  and  III,  are  given  in  Table  I  for  general 
use.  Unless  otherwise  specified,  Inspection 
Level  II  will  be  used.  However,  Inspection 
Level  I  may  be  specified  when  less  discrimi- 
nation is  needed,  or  Level  III  may  be  speci- 
fied /or  greater  discrimination.  Four  addi- 
tional special  levels:  S—l,  S-2,  S-3  and  S-4, 
are  given  in  the  same  table  and  may  be  used 
where  relatively  small  sample  sizes  are  neces- 
sary and  large  sampling  risks  can  or  must  be 
tolerated. 

NOTE:  In  the  designation  of  inspection 
levels  S-l  to  S-4,  care  must  be  exercised  to 
avoid  AQLs  inconsistent  with  these  inspec- 
tion levels. 


9.3  CODE  LETTERS.  Sample  sizes  are 
designated  by  code  letters.  Table  I  shall  be 
used  to  find  the  applicable  code  letter  for  the 
particular  lot  or  batch  size  and  the  prescribed 
inspection  level. 

9.4  OBTAINING  SAMPLING  PLAN.  The 
AOL  and  the  code  letter  shall  be  used  to  ob- 


tain the  sampling  plan  from  Tables  IT,  III  or 
IV.  When  no  sampling  plan  is  available  for  a 
given  combination  of  AQL  and  code  letter, 
the  tables  direct  the  user  to  a  different  letter. 
The  sample  size  to  be  used  is  given  by  the 
new  code  letter  not  by  the  original  letter.  If 
this  procedure  leads  to  different  sample  sizes 
for  different  classes  of  defects,  the  code  letter 
corresponding  to  the  largest  sample  size  de- 
rived may  be  used  for  all  classes  of  defects 
when  designated  or  approved  by  the  respon- 
sible authority.  As  an  alternative  to  a  single 
sampling  plan  with  an  acceptance  number 
of  0,  the  pian  with  an  acceptance  number  of  I 
with  its  correspondingly  larger  sample  sizs 
for  a  designated  AQL  (where  available),  may 
be  used  when  designated  or  approved  by  the 
responsible  authority. 

9.5  TYPES  OF  SAMPLING  PLANS.  Three 
types  of  sampling  plans:  Single,  Double  and 
Multiple,  are  given  in  Tables  II,  III  and  IV, 
respectively.  When  several  types  of  plans  are 
available  for  a  given  AQL  and  code  letter, 
any  one  may  be  used.  A  decision  as  to  type 
of  plan,  either  single,  double,  or  multiple, 
when  available  for  a  given  AQL  and  code 
letter,  will  usually  be  based  upon  the  com- 
parison between  the  administrative  difficulty 
and  the  average  sample  sizes  of  the  available 
plans.  The  average  sample  size  of  multiple 
plans  is  less  than  for  double  (except  in  the 
case  corresponding  to  single  acceptance  num- 
ber 1 )  and  both  of  these  are  always  less  than 
a  single  sample  size.  Usually  the1  administra- 
tive difficulty  for  single  sampling  and  tho 
cost  per  unit  of  the  sample  are  less  than-scr 
double  or  multiple. 
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10.      DETERMINATION   OF  ACCEPTABILITY 


10.1  PERCENT  DEFECTIVE  INSPECTION. 
To  determine  acceptability  of  a  lot  or  batch 
under  percent  defective  inspection,  the  ap- 
plicable sampling  plan  shall  be  used  in 
accordance  with  10 .1.1,  10.1.2,  10.1.3,  10.1.4, 
and  10.1.5. 

10.1.1  SINGLE  SAMPLING  PLAN.  Tne 
number  of  sample  units  inspected  shall  be 
equal  to  the  sample  size  given  by  the  plan. 
If  the  number  of  defectives  found  in  the 
sample  is  equal  to  or  less  than  the  acceptance 
number,  the  lot  or  batch  shall  be  considered 
acceDtabie.  If  the  number  of  defectives  is 
equal  10  or  greater  tnan  the  rejection  num- 
ber, tne  lot  or  batch  shall  be  rejected. 

IC.1.2  DOUBLE  SAMPLING  PLAN.  Tne 
number  of  sample  units  inspected  shall  be 
equal  to  the  first  sample  size  given  by  the 
pian.  If  the  number  of  defectives  found  in 
the  first  sample  is  equal  to  or  less  than  the 
fcrs-w  acceptance  number,  the  lot  or  batch 
en-vii  be  considered  acceptable.  If  the  num- 
e«r  ©£  d-eiectives  found  in  the  first  sample  is 
ecru&i  to  or  greater  than  the  first  rejection 
Bomber,  the  lot  or  batch  shall  be  rejected. 
If  ties  nuaaber  of  defectives  found  in  the  first 
acutapie  is  between  the  first  acceptance  and 
rejection  numbers,  a  second  sample  of  the 
c&te  given  by  the  plan  shall  be  inspected.  The 


number  of  defectives  found  in  the  first  and 
second  samples  shall  be  accumulated.  If  the 
cumulative  number  of  defectives  is  equal  to 
or  less  than  the  second  acceptance  number, 
the  lot  or  batch  shall  be  considered  accept- 
able. If  the  cumulative  number  of  defectives 
is  equal  to  or  greater  than  the  second  rejec- 
tion number,  the  lot  or  batch  shall  be  rejected. 

10.1.3  MULTIPLE  SAMPLE  PLAN.  Under 
multiple  sampling,  the  procedure  shall  be 
similar  to  that  specified  in  10.1.2,  except  that 
the  number  of  successive  samples  required 
to  reach  a  decision  may  be  more  than  two. 

10.1 .4  SPECIAL  PROCEDURE  FOR  RE- 
DUCED  INSPECTION.  Under  reduced  in- 
spection, the  sampling  procedure  may  termi- 
nate without  either  acceptance  or  rejection 
criteria  having  been  met.  In  these  circum- 
stances, the  lot  or  batch  will  be  considere-d 
acceptable,  but  normal  inspection  will  bs 
reinstated  starting  with  the  next  iot  or 
batch  (see  8.3.4   (b)}. 

10.2  DEFECTS  PER  HUNDRED  UNITS  IN- 
SPECTION. To  determine  the  acceptability 
of  a  lot  or  batch  under  Defects  per  Hundred 
Units  inspection,  the  procedure  specified  for 
Percent  Defective  inspection  above  shall  be 
used,  except  that  the  word  "defects"  shall  be 
substituted  for  "defectives." 


II.     SUPPLEMENTARY   INFORMATION 


11.1  OPIEATIKQ  CHARACTERISTIC 
CURVES.  The  op^rstiog  characteristic  curves 
tec  normal  inspection,  shown  in  Table  X 
(pg$8c  30-62),  indicate  the  percentage  of 
kte  «r  batches  which  may  be  expected  to  be 
caz3%zte*L  under  the  various  sampling  plaru 
vse  a  g«vaa  orocess  quality.  The  curves  shown 
are  scr  aea^Ae  sampling;  curves  for  double 


and  multiple  sampling  are  matched  as  closely 
as  practicable.  The  O.  C.  curves  shown  ior 
AQLs  greater  than  10.0  are  baaed  on  the 
Poisson  distribution  and  are  applicable  fcr 
defects  per  hundred"  units  inspection;  thofcs 
for  AQLs  of  10.0  or  less  and  sample  sixes  ex 
80  or  less  are  based  on  the  binomial  distri- 
bution and  are  applicable  ior  percent  deiec- 


62 
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tive  inspection;  those  for  AQLs  of  10.0  or 
less  and  sample  sizes  larger  then  80  are  based 
on  the  Poisson  distribution  and  are  applica- 
ble either  for  defects  per  hundred  units  in- 
spection, or  for  percent  defective  inspection 
(the  Poisson  distribution  being  an  adequate 
approximation  to  the  binomial  distribution 
under  these  conditions).  Tabulated  values, 
corresponding  to  selected  values  of  probabil- 
ities of  acceptance  (Pa,in  percent)  are  given 
for  each  of  the  curves  shown,  and,  in  addi- 
tion, for  tightened  inspection,  and  for  defects 
per  hundred  units  for  AQLs  of  10.0  or  less 
and  sample  sizes  of  80  or  less. 

11.2  PROCESS  AVERAGE.  The  process 
average  is  the  average  percent  defective  or 
average  number  of  defects  per  hundred  units 
(whichever  is  applicable)  of  product  sub- 
mitted by  the  supplier  for  original  inspec- 
tion. Original  inspection  is  the  first  inspec- 
tion of  a  particular  quantity  of  product  as 
distinguished  from  the  inspection  of  product 
which  has  been  resubmitted  after  prior 
rejection. 

11.3  AVERAGE  OUTGOING  QUALITY 
(AOQ).  The  AOQ  is  the  average  quality  of 
outgoing  product  including  all  accepted  lots 
or  batches,  plus  all  rejected  lots  or  batches 
after  the  rejected  lots  or  batches  have  been 
effectively  100  percent  inspected  and  all  de- 
fectives replaced  by  nohdefectives. 

11.4  AVERAGE  OUTGOING  QUALITY 
LIMIT  (AOQL).  The  AOQL  is  the  maximum 
of  the  AOQs  for  all  possible  incoming  quali- 
ties for  a  given  acceptance  sampling  plan. 
AOQL  values  are  given  in  Table  V-A  for 
each  of  the  single  sampling  plans  for  normal 
Inspection  and  in  Table  V-B  for  each  of  the 
isigie  sampling  plans  for  tightened  inspec- 


11.5  AVERAGE    SAMPLE    SIZE    CURVES. 

Average  sample  size  curves  for  double  and 
multiple  sampling  are  in  Table  IX.  These 
show  the  average  sample  sizes  which  may  be 
expected  to  occur  under  the  various  sampling 
plans  for  a  given  process  quality.  The  curves 
assume  no  curtailment  of  inspection  and  are 
approximate  to  the  extent  that  they  are 
based  upon  the  Poisson  distribution,  and  that 
the  sample  sizes  for  double  and  multiple 
sampling  are  assumed  to  be  0.631n  and  0.25n 
respectively,  where  n  is  the  equivalent  single 
sample  size. 

11.6  LIMITING    QUALITY    PROTECTION. 

The  sampling  plans  and  associated  proce- 
dures given  in  this  publication  were  designed 
for  use  where  the  units  of  product  are  pro- 
duced in  a  continuing  series  of  lots  or  batches 
over  a  period  of  time.  However,  if  the  lot 
or  batch  is  of  an  isolated  nature,  it  is  desira- 
ble to  limit  the  selection  of  sampling  plans 
to  those,  associated  with  a  designated  AQL 
value,  that  provide  not  less  than  a  specified 
limiting  quality  protection.  Sampling  plans 
for  this  purpose  can  be  selected  by  choosing 
a  Limiting  Quality  (LQ)  and  a  consumer's 
risk  to  be  associated  with  it.  Tables  VI  and 
VII  give  values  of  LQ  for  the  commonly  used 
consumer's  risks  of  10  percent  and  5  percent 
respectively.  If  a  different  value  of  con- 
sumer's risk  is  required,  the  O.C.  curves  and 
their  tabulated  values  may  be  used.  The 
concept  of  LQ  may  also  be  useful  in  specify- 
ing the  AQL  and  Inspection  Levels  for  a 
series  of  lots  or  batches,  thus  fixing  minimum 
sample  size  where  there  is  some  reason  for 
avoiding  (with  more  than  a  given  consumer's 
risk)  more  than  a  limiting  proportion  of  de- 
fectives (or  defects)  in  any  single  lot  or 
batch. 
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Index   oj   terms   with    special    meanings 

Term  Paragraph 


Acceptable  Quality  Level  (AQL )  4  2  and    11  1 

Acceptance   number  9  4  and    10  1  1 

Attributes      .     ...         1.4 

Average  Outgoing  Quality   (AOQ)  113 

Average  Outgoing  Quality  Limit   (AOQL)  114 

Average   sample   size 11  5 

Batch    ...         5  1 

Classification  of  defects  2  1 

Code    letters  9  3 

Critical  defect  2.1.1 

Critical  defective      22  1 

Defect  2.1 

Defective  unit  2.2 

Defects  per  hundred  units 3.3 

Double  sampling  plan  10.1  2 

Inspection  1.3 

Inspection  by  attributes      .  1  4 

Inspection  level  9  2 

Inspection  lot  or  inspection  batch    5  1 

Isolated    lot  11.6 

Limiting  Quality    (LQ)  ...      116 

Lot  5. J 

Lot  or  batch   size  5  3 

Major   defect  ...  2.1.2 

Major    defective  2.2.2 

Minor   defect  2.1  3 

Minor  defective    2  2  3 

Multiple  sampling  plan  10  1.3 

Normal    inspection       8.1   and   8  2 

Operating   characteristic   curve     11.1 

Original  inspection    

Percent  defective      

Preferred    AQLs 
Process  average 
Reduced    inspection 

Rejection  number  

Responsible   authority 
Resubmitted  lots  or  batches 

Sample    

Sample  size 

Sample  size  code  letter       

Sampling  plan 
Single  sampling  plan 

Small-sample   inspection  

Switching  procedures  

Tightened   inspection  

Unit  of  product      .    ... 


11.2 

32 

46 

11  2 

8  2  and 

83  3 

10  1  1 

11 

6.4 

7.1 

7  1 

4  1    and 

93 

9  5 

10  1  1 

92 

83 

8  2   and 

8  3  1 

1  5 
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Copies  of  this  standard  may  be  obtained  by  directing  requests  to+ 

Commanding  Officer 
U.S.  Naval  Supply  Depot 
A'iTN:  Code  DMD 
5801  Tabor  Avenue 
Philadelpiiia  20,  Pennsylvania 

Copies  of  this  Military  Standard  may  be  obtained  for  other  than 
official  use  by  individuals,  firms,  and  contractors  from  the  Superintendent 
of  Documents,  U.S.  Government  Printing  Office,  Washington  25,  D.  C. 

Both  the  title  and  identifying  symbol  number  should  be  stipulated 
when  requesting  copies  of  Military  Standards. 

Custodians: 

Army  -  Munitions  Command 

Navy  -  Bureau  of  Weapons 

Air  Force  -  Air  Force  Logistics  Command 

Defense  Supply  Agency 

Preparing  Activity: 

Army  -  Munitions  Command 

£U.S.  GOVERNMENT  PRINTING  OFFICE:  1980-603-121/4090 
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APPENDIX  B 
AQAS  SYSTEM  DATA-FLOW  DIAGRAMS 


-DATE. 


SYSTEn  COMMANDS 


5/AMPZ.£    //V FORMATION 


SAMPLE   DESiGNATjorj 


iNSPeCT/oN     R.S5ULTS 


M£NU  M£.SSAG£S  ] 


SAM  Pie  USv 


T)rt£Lirt£  ss   tzzrczr 


qUALlT-Y    fcL£POrzr 


Epeofc.  nesjzAGSS 


IWSP£CT/QU  fZ£Sv<-Tj^ 


Fig.     1       Svsterr:    Overview 


12  0 


Fiqure  2.  First  Expansion  -  Main  Module 
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Fjcur- 


first  Expansion  -  Select  Module 


1/YPvT     ofcC£(Z 


<      fcr-se^J 


Figure 


'irsi  Exoansion  -  Incut  Mod' 


^j  e 


Jul/ 4*/ j 

CyOVT 


&-CMOri£P 


Figure    5.    First    Expansion    -    Analyze    Module 


12 


oru/Ty  oet>£/? 


fctT-cJ/Lhl 


rx.rs,_    bxpansion    -    Utilif 


A]odui< 
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APPENDIX  C 
AQAS  SYSTEM  CODE 

*  MODULE  0.0 

*  SINON.CMD     VERSION  1.0     2  0  MAR  8  4       HEM 

*  This  module  welcomes  the  user  to  the  Automated  Quality  Assurance 

*  System. 

*  Format  file  used:  SINON.FMT 

*  Display  logon  message. 
SET  FORMAT  TO  sinon 

READ 

DO  delay2 

*  Commence  program 
DO  main 
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*  MODULE  0.0.1 

*  SINON.FMT     VERSION  1.0 


2  0  MAR  8  4 


HEM 


§ 

§ 
e 
e 
e 
e 
@ 
@ 
e 

e 
§ 
@ 

§ 

e 
e 
e 

e 

@ 
@ 
§ 
§ 

e 
§ 
@ 
§ 

§ 
e 

e 
@ 
@ 
@ 
e 
e 
@ 
e 
@ 
@ 
@ 
e 
e 


9 

9 
10 
10 
11 
11 
12 
12 
13 
13 
14 
14 
15 
15 
16 
16 
17 
17 
18 
18 
19 
19 
20 
20 
21 
21 
22 
22 


0  SAY 

50  SAY 
0  SAY 

7  9  SAY 
0  SAY 

7  9  SAY 
0  SAY 

51  SAY 
0  SAY 

5  0  SAY 

0  SAY 
7  9  SAY 

0  SAY 
7  9  SAY 

0  SAY 
7  9  SAY 

0  SAY 
7  9  SAY 

0  SAY 
5  0  SAY 

0  SAY 
7  9  SAY 

0  SAY 
7  9  SAY 

0  SAY 
7  9  SAY 

0  SAY 
7  9  SAY 

0  SAY 
7  9  SAY 

0  SAY 
7  9  SAY 

0  SAY 
5  0  SAY 

0  SAY 
7  9  SAY 

0  SAY 
5  0  SAY 

0  SAY 
7  9  SAY 

0  SAY 
7  9  SAY 

0  SAY 
7  9  SAY 

0  SAY 
5  0  SAY 


:+" 


I  " 


I  » 
I 

PROGRAM 
i 

D 

i  " 

I  " 

i  " 

i  » 
i 

I  " 

i  " 

i  " 
i 

TION  CENTER 
j 
i  » 

;  » 

i  " 

i  » 

i  " 

i  " 

i  " 
i 

i  " 

i  » 

j  " 
i 


AUTOMATED  QUALITY  ASSURANCE" 
i  » 

Utilizing  MIL-STD  105" 
i  " 


Developed  for" 


THE  NAVAL  REGIONAL  DATA  AUTOMA" 
i  " 


San  Francisco,  CA." 


SN 
i  " 


ool 
i 

i  » 
i  •• 
j  " 
i  " 
i  " 


by" 


LT  Howard  E.  Morton,  U" 
i  " 


Naval  Postgraduate  Sch" 


Monterey,  CA." 


:+" 
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*  MODULE  0 . 1 

*  SETJULN.CMD        VERSION  1.2     2  5  MAR  8  4       HEM 

*  This  module  allows  the  user  to  enter  or  change  the  Julian 

*  date  of  the  QA  action  to  be  performed. 

*  FMT  FILE  USED:  setjuln 

*  CALLED  BY:  main.cmd 

SAVE  TO  keepem 

CLEAR 

RESTORE  FROM  keepem 

*  Prevent  calculations  showing  on  screen 
SET  TALK  OFF 

*  Initialize  variables 
STORE  0  TO  date 

*  Define  format 

SET  FORMAT  TO  setjuln 

*  Execute 
READ 

LOCATE  ALL  FOR  Julian  =  date 
IF  EOF 

APPEND  BLANK 

REPLACE  Julian  WITH  date 
ENDIF 


*  Return  to  calling  program 

RETURN 
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*  MODULE  0.0.1 

*  SETJULN.FMT   VERSION  1.0 


2  5  MAR  8  4 


HEM 


4, 
4, 
5, 
5, 
6, 
6, 
7  , 
7  , 
7, 
7, 


9, 
9, 


8  SAY  "Specify  Julian  Date  for" 

3  2  SAY  mode 

0  SAY   "+=======================: 

5  0  SAY 

0  SAY 

7  9  SAY 

0  SAY 

5  0  SAY  "ion 

5  5  GET  date 

7  9  SAY 

0  SAY 

7  9  SAY 

0  SAY 

5  0  SAY 


:+" 


For  which  Julian  date  do  you  want  to  take  act" 


■?  •• 


=  +" 
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*  MODULE  0.2.2 

*  DELAY2.CMD 

*  This  module  provides  a  short  delay  to  allow  the  user  to  read  a 

*  screen  before  the  program  moves  on. 

SET  TALK  OFF 

STORE  1  TO  tx 

DO  WHILE  tx  <  200 

STORE  tx  +  1  TO  tx 
ENDDO 
ERASE 

RELEASE  ALL  LIKE  tx 
RETURN 
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*  MODULE  0.2.5 

*  DELAY5.CMD 

*  This  module  provides  a  short  delay  to  allow  the  user  to  read  a 

*  screen  before  the  program  moves  on. 

SET  TALK  OFF 

STORE  1  TO  tx 

DO  WHILE  tx  <  5  00 

STORE  tx  +  1  TO  tx 
ENDDO 
ERASE 

RELEASE  ALL  LIKE  tx 
RETURN 
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*  MODULE  1.0 

*  MAIN.CMD  VERSION  2.4     12  APR  8  4       HEM 

*  This  is  the  main  program  of  the  Automated  Quality  Assurance 

*  System. 
* 

*  FMT  FILE  USED:  MAIN.fmt 

*  CALLED  BY:  LOGON.CMD 

*  Allow  both  upper  and  lower  case  inputs 
SET  EXACT  OFF 

SAVE  TO  keepem 

CLEAR 

RESTORE  FROM  keepem 

STORE  T  TO  go 

*  Set  up  the  loop 
DO  WHILE  go 

*  Set  up  screen  and  prompts 
SET  FORMAT  TO  main 

STORE  "  "  TO  command 

READ 

*  Perform  selected  function 
DO  CASE 

CASE  command  =  "1" 
DO  select 

CASE  command  =  "2" 
DO  input 

CASE  command  =  "3" 
DO  analyze 

CASE  command  =  "4" 
DO  utility 

CASE  command  =  "~" 
ERASE 

*Prevent  the  dBASE  II  sign-off  message 
SET  CONSOLE  OFF 
QUIT 

CASE  command  =  "%" 
ERASE 
CLEAR 
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CANCEL 

ENDCASE 

RELEASE  command 
ENDDO 
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*  MODULE  1 . 1 

*  MAIN.FMT 


VERSION  2 


12  APR  8  4 


HEM 


9 
9 
10 
10 
11 
11 
12 
12 
13 
13 
14 
14 
15 
15 
16 
16 
16 
17 
17 
18 
18 


3  5  SAY 
0  SAY 

5  0  SAY 

0  SAY 

7  9  SAY 

0  SAY 

5  0  SAY 

0  SAY 

7  9  SAY 

0  SAY 

7  9  SAY 

0  SAY 

7  9  SAY 

0  SAY 

7  9  SAY 

0  SAY 

7  9  SAY 

0  SAY 

7  9  SAY 

0  SAY 

7  9  SAY 

0  SAY 

7  9  SAY 

0  SAY 

7  9  SAY 

0  SAY 

7  9  SAY 

0  SAY 

7  9  SAY 

0  SAY 

4  4  GET 
7  9  SAY 

0  SAY 

7  9  SAY 

0  SAY 

5  0  SAY 


Main  Menu" 


Welcome  to  NARDAC  San  Francisco's  Automated  Q" 
uality  Assurance  System.      !" 

You  have  four  options  at  this  initial  point:" 


1.  Initiate  the  sample  selection  process." 


2.  Input  the  sample  and  inspection  data." 


3.  Analyze  the  data  and  generate  reports." 


4.  Go  to  the  Utility  Menu." 


PLEASE  CHOOSE  ONE  OPTION  AT  THIS  TIME" 
command 


:+" 
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*  MODULE  2.0 

*  SELECT.CMD   VERSION  2.3        2  0  MAR  8  4        HEM 

*  This  is  the  Sample  Selection  Module. 
* 

*  FMT  FILE  USED:  SELECT. FMT 

*  CALLED  BY  MAIN.CMD 

SAVE  TO  keepem 

CLEAR 

RESTORE  FROM  keepem 

*  Restore  seed  value 
RESTORE  FROM  startup  ADDITIVE 

*  Prevent  calculations  from  being  shown  on  screen 
SET  TALK  OFF 

*  Set  up  screens  and  prompts 

STORE  "Sample  Selection"  TO  mode 

STORE  "  "  TO  insplvl 

STORE  0  TO  noevents 

STORE  0  TO  sampnum 

STORE  1  TO  xcounter 

STORE  0  TO  xrandom 

STORE  "Normal"  to  rcmdl 

STORE  "Tightened"  to  rcmd2 

STORE  "Reduced"  to  rcmd3 

DO  setjuln 

SET  FORMAT  TO  select 

USE  brdaydata 

LOCATE  FOR  Julian  =  date 

IF  EOF 

APPEND  BLANK 

REPLACE  Julian  WITH  date 
ENDIF 
SKIP  -1 

STORE  rcmdinsp  TO  rcmd4 
STORE  Julian  TO  xprev 

*  Define  the  file  to  be  used,  and  clear  it  of  previous  entries 
USE  b:sampfile 

DELETE  ALL 
PACK 

*  Get  number  of  events  and  inspection  level  from  user. 
READ 
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*  Give  the  user  something  to  read  during  calculation 
ERASE 

@  8,10  SAY "GENERATING  RANDOM  SAMPLES  AT  THIS  TIME" 

*  Determine   the   number   of   samples   to   be   taken   given   the 

*  inspection  level  input  and  the  number  of  events. 
DO  SAMPGEN 

*  Generate  n  unique  random  samples,   where  n  =  sampnum,   and  the 

*  range  of  the  samples  is  from  1  to  noevents. 
DO  RANDGEN 

*  Inform  user  that  sample  selection  is  complete,  and  give  him 

*  instructions  on  how  to  return  to  Main  Menu. 
ERASE 

@  6  10  SAY"******************************" 
@  7,10  SAY"*  *" 

@  8,10  SAY"*  SAMPLE  GENERATION  COMPLETE  *" 
@  9,10  SAY"*  *" 

@  10  10  S AY "******************************" 
DO  delay2 

USE  b:daydata 

LOCATE  FOR  Julian  =  date 

IF  .NOT.  EOF 

REPLACE  samps  WITH  sampnum 
REPLACE  events  WITH  noevents 
DO  CASE 

CASE  insplvl  =  "1" 

REPLACE  finsplvl  WITH  rcmdl 

CASE  insplvl  =  "2" 

REPLACE  finsplvl  WITH  rcmd2 

CASE  insplvl  =  "3" 

REPLACE  finsplvl  WITH  rcmd3 
ELSE 

DO  selerrl 
DO  delay2 
ENDIF 

RELEASE  ALL  LIKE  rcmd* 
RELEASE  ALL  LIKE  x* 

DO  notify 

RETURN 


136 


*  MODULE  2.0.1 

*  SELECT. FMT 


VERSION  1 


10  MAR  8  4 


HEM 


3  4  SAY 
0  SAY 

5  0  SAY 
0  SAY 

7  9  SAY 
0  SAY 

5  0  SAY 

6  2  SAY 

7  3  SAY 
0  SAY 

5  0  SAY 
0  SAY 

3  9  SAY 

5  5  SAY 
0  SAY 

7  9  SAY 
0  SAY 

7  9  SAY 
0  SAY 

7  9  SAY 
0  SAY 

4  7  SAY 
60  SAY 

6  2  GET 
79  SAY 

0  SAY 

7  9  SAY 
0  SAY 

5  0  SAY 
0  SAY 

7  9  SAY 

0  SAY 
7  9  SAY 

0  SAY 
7  9  SAY 

0  SAY 
7  9  SAY 

0  SAY 
7  9  SAY 

0  SAY 
7  9  SAY 

0  SAY 
7  9  SAY 

0  SAY 
2  8  GET 
7  9  SAY 

0  SAY 
7  9  SAY 


Based  on  the  results  of  inspection  process  co" 
'mpleted  for" 
xprev 

i  » 

¥  • 

'!     the  Automated  Quality  Assurance  Program  recom" 

'mends  that  today's  !" 

'!     inspection  be  conducted  under  the" 

rcmd4 

'inspection  level         !" 

in  accordance  with  MIL  STD  105D." 
ii 


date 
i  .  ii 


'Select  Menu" 


+= 


:+" 


ENTER  THE  NUMBER  OF  EVENTS  FOR  JULIAN  DATE" 


noevents 


Select  The  Inspection  Level  to  be  used  for  th" 
'is  day  's  run.  ! " 


1.  Normal  Inspection" 


2.  Increased  Inspection" 


3.  Reduced  Inspection" 


ENTER  INSPECTION  LEVEL" 
insplvl 
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21,    0 
21,50 


SAY    " =============================+ " 
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*  MODULE  2 . 1 

*  SAMPGEN.CMD   VERSION  1.1     9  MAY  8  4         HEM 

*  This  is  the  Sample  Number  Generation  Module 

*  CALLED  BY  SELECT.CMD 

*  Given  the  number  of  events  for  the  day  (noevents)  and  the 

*  inspection  level  desired,  generate  the  number  of  samples  to  be 

*  taken. 

SAVE  TO  keepem 

CLEAR 

RESTORE  FROM  keepem 

DO  CASE 

CASE  insplvl  =  "1"  .OR.  insplvl  =  "2" 
DO  CASE 

CASE  noevents  >=  2  .AND.  noevents  <=  8 
STORE  2  TO  sampnum 

CASE  noevents  >=  9  .AND.   noevents  <=  15 
STORE  3  TO  sampnum 

CASE  noevents  >=  16  .AND.  noevents  <=  25 
STORE  5  TO  sampnum 

CASE  noevents  >=  26  .AND.  noevents  <=  50 
STORE  8  TO  sampnum 

CASE  noevents  >=  51  .AND.  noevents  <=  9  0 
STORE  13  TO  sampnum 

CASE  noevents  >=  91  .AND.  noevents  <=  150 
STORE  2  0  TO  sampnum 

CASE  noevents  >=  151  .AND.  noevents  <=  280 
STORE  3  2  TO  sampnum 

CASE  noevents  >=  281  .AND.  noevents  <=  500 
STORE  5  0  TO  sampnum 

CASE  noevents  >=  501  .AND.  noevents  <=  1200 
STORE  80  TO  sampnum 

CASE  noevents  >=  1201  .AND.  noevents  <=  3200 
STORE  12  5  TO  sampnum 

CASE  noevents  >=  3201  .AND.  noevents  <=  10000 
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STORE  200  TO  sampnum 


CASE  noevents  >=  10001  .AND.  noevents  <=  35000 
STORE  315  TO  sampnum 

CASE  noevents  >=  35001  .AND.  noevents  <=  150000 
STORE  50  0  TO  sampnum 

CASE  noevents  >=  150001  .AND.  noevents  <=  500000 
STORE  800  TO  sampnum 

CASE  noevents  >  500001 
STORE  125  0  TO  sampnum 

OTHERWISE 

ERASE 

@  8,15  SAY  "NUMBER  OF  EVENTS  ENTERED  IS  OUT  OF  RANGE" 

@  10,15  SAY  "OF  THIS  PROGRAM.  PLEASE  CONTACT  YOUR" 

@  12,15  SAY  "SUPERVISOR" 

@  16,15  SAY  "Press  any  key  to  continue" 

@  17,1  SAY 

@  18,1  SAY 

@  19,1  SAY 

@  2  0,1  SAY 

@  21,1  SAY 

@  2  2,1  SAY 

WAIT 


ENDCASE 

CASE  insplvl  =  "3" 
DO  CASE 

CASE  noevents  >=  2  .AND.  noevents  <=  25 
STORE  2  TO  sampnum 


CASE  noevents  >=  26  .AND.  noevents  <: 
STORE  3  TO  sampnum 
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CASE  noevents  >=  51  .AND.  noevents  <=  90 
STORE  5  TO  sampnum 

CASE  noevents  >=  91  .AND.  noevents  <=  150 
STORE  8  TO  sampnum 

CASE  noevents  >=  151  .AND.  noevents  <=  280 
STORE  13  TO  sampnum 

CASE  noevents  >=  281  .AND.  noevents  <=  500 
STORE  2  0  TO  sampnum 
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CASE  noevents  >=  501  .AND.  noevents  <=  1200 
STORE  3  2  TO  sampnum 

CASE  noevents  >=  1201  .AND.  noevents  <=  3200 
STORE  5  0  TO  sampnum 

CASE  noevents  >=  3201  .AND.  noevents  <=  10000 
STORE  8  0  TO  sampnum 

CASE  noevents  >=  10001  .AND.  noevents  <=  35000 
STORE  125  TO  sampnum 

CASE  noevents  >=  35001  .AND.  noevents  <=  150000 
STORE  20  0  TO  sampnum 

CASE  noevents  >=  150001  .AND.  noevents  <=  500000 
STORE  315  TO  sampnum 

CASE  noevents  >  500001 
STORE  50  0  TO  sampnum 

OTHERWISE 

ERASE 

@  8,15  SAY  "NUMBER  OF  EVENTS  ENTERED  IS  OUT  OF  RANGE" 

@  10,15  SAY  "OF  THIS  PROGRAM.  PLEASE  CONTACT  YOUR" 

@  12,15  SAY  "SUPERVISOR" 

@  16,15  SAY  "Press  any  key  to  continue" 

@  17,1  SAY 

@  18,1  SAY 

@  19,1  SAY 

@  20,1  SAY 

@  21,1  SAY 

@  2  2,1  SAY 

WAIT 


ENDCASE 
ENDCASE 
RETURN 
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*  MODULE  2.2 

*  RANDGEN.CMD   VERSION  1.1         3  MAR  8  4         HEM 

*  This  is  module  generates  n  unique  random  samples  where  n  = 

*  sampnum,   and  the  range  of  n  is  from  1  to  the  number  of  events 

*  for  a  given  day  (noevents). 
* 

*  CALLED  BY  SELECT.CMD 

*  Generate  n  random  samples,  where  n  =  sampnum,  and  range  of  n 

*  is  from  1  to  noevents. 

SAVE  TO  keepem 

CLEAR 

RESTORE  FROM  keepem 

USE  b:sampfile 

*  Initialize  counter 
STORE  1  TO  counter 

*  Set  up  loop  to  occur  n  times,  where  n  =  sampnum 
DO  WHILE  counter  <=  sampnum 

*  Increment  counter. 

STORE  counter  +  1  TO  counter 

*  Calculate  pseudorandom  number 
STORE  seed  +  3.14159265  TO  seed 
STORE  seed  *  seed  TO  seed 
STORE  seed  -  INT (seed)  TO  seed 

*  Multiply  pseudorandom  number  by  the  number  of  events  to 

*  obtain  sample  number,  and  store  to  random. 
STORE  1  +  INT (noevents  *  seed)  TO  random 

*  Ensure  that  random  not  larger  than  sampnum,  nor  smaller 

*  than  1.  If  so,  ignore  random  and  decrement  counter  by  1. 
DO  CASE 

CASE  random  >  noevents  .OR.  random  <  1 
STORE  counter  -  1  TO  counter 

OTHERWISE 

*  Ensure  that  the  samples  generated  are  unique.  If  not, 

*  do  not  append  the  sample  to  the  list,  but  decrement 

*  the  counter  by  1 . 

LOCATE  ALL  FOR  random  =  eventno 
IF  EOF 
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APPEND  BLANK 

REPLACE  eventno  WITH  random 
ELSE 

STORE  counter  -  1  TO  counter 
ENDIF 

ENDCASE 
ENDDO 
*  Save  the  seed  value 
SAVE  TO  startup  ALL  LIKE  seed 
ENDDO 
RETURN 
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*  MODULE  2 . 3 

*  NOTIFY.CMD         VERSION  1.3        9  MAY  8  4       HEM 

*  This  module  notifies  Quality  Assurance  personnel  of  the 

*  events  to  be  sampled. 

*  FMT  FILES  USED:  NOTIFYl.FMT  and  N0TIFY2.FMT 

*  OUTPUT  FORMS  USED:  SAMPRPT.FRM 

*  THIS  MODULE  CALLED  BY:  SELECT.CMD 

SAVE  TO  keepem 

CLEAR 

RESTORE  FROM  keepem 

*  Input  date  into  report  header 
STORE  Y  TO  t: order 

STORE  STR(DATE,5)  TO  dte 

SET  HEADING  TO  INSPECTION  LIST  TOR  JULIAN  DATE  &dte 

*  Specify  file  to  be  used 
USE  b:sampfile 

*  Arrange  the  file  in  numerical  order 
INDEX  ON  eventno  TO  b:samplist 

*  Display  initial  NOTIFY  messages  and  cautions. 
SET  FORMAT  TO  notifyl 

READ 

DO  delay2 

*  Advise  the  user  of  the  utilization  of  this  list. 
SET  FORMAT  TO  notify2 

READ 

DO  delay5 

*  Perform  output  in  printed  format 

SET  PRINT  ON 

REPORT  FORM  samprpt 

EJECT 

SET  PRINT  OFF 

*  Return  to  the  Calling  Program 
RETURN 
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*  MODULE  2.3.1 

*  NOTIFY1.FMT 


VERSION  1 .0 


12  APR  8  4 


HEM 


e 
@ 
i 
§ 
e 
e 
@ 
e 
@ 
e 

e 
§ 
@ 
e 

e 
@ 


8  10 
@  10 

e  n 

@  ii 


3  0  SAY 

0  SAY 
5  0  SAY 

0  SAY 
7  9  SAY 

0  SAY 
5  0  SAY 

0  SAY 
5  0  SAY 

0  SAY 
5  0  SAY 

0  SAY 
5  0  SAY 

0  SAY 
7  9  SAY 

0  SAY 
5  0  SAY 

0  SAY 
7  9  SAY 

0  SAY 
7  9  SAY 

0  SAY 
5  0  SAY 


:+» 


'Sample  Notification" 

I _____________________________ 

i  ,  it 
I  ,  ii 

'!     At  this  point,  the  system  has  generated  a  ser" 

'ies  of  random  numbers         ! " 

'  !     which  are  equal  in  number  to  the  number  of  sa" 

'mples  that  must  be  ! " 

1  !     taken  given  the  number  of  events  and  the  insp" 

'ection  level  you  input        ! " 

'!     during  the  Sample  Selection  process,  precedin" 

•g.  1" 

i  ,  ii 

i  ,  ii 

1  !     This  is  a  good  time  to  take  a  minute  and  read" 

'y  the  printer.  !" 

i  ,  ii 

i  ,  ii 

i  ,  ii 

i  |  ii 


=  +" 
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*  MODULE  2.3.2 

*  NOTIFY2.FMT 


VERSION  1.0 


12  APR  84 


HEM 


@ 

1, 

@ 

2, 

e 

2, 

@ 

3, 

@ 

3, 

@ 

4, 

@ 

4, 

e 

5, 

@ 

5, 

@ 

5, 

@ 

6, 

@ 

6, 

@ 

6, 

@ 

7, 

@ 

7, 

@ 

8, 

@ 

8, 

@ 

9, 

@ 

9, 

@ 

10, 

@ 

10, 

@ 

10, 

0 

11, 

@ 

11, 

@ 

12, 

Ca 

12, 

@ 

13, 

(a 

13, 

@ 

14, 

(a 

14, 

@ 

15, 

@ 

15, 

@ 

16, 

(a 

16, 

31  SAY  "Sample  Notification" 

0  SAY  "+=================================================" 

50  SAY  "=============================+" 

0  SAY  " ! " 

7  9  SAY  "!" 

0  SAY  "!     This  list  delineates  those  events  which  you  w" 

50  SAY  "ill  be  using  for  I" 

0  SAY  "!     inspection  purposes.  The" 

2  9  SAY  sampnum 

42  SAY  "samples  have  been  calculated         !" 

0  SAY  " !     by  the  system  based  on  your  input  of" 

4  2  SAY  noevents 

56  SAY  "events  and  the  !" 

0  SAY  "!     level  of  inspection  desired.  To  use  the  list" 

50  SAY  "which  will  be  provided        !" 

0  SAY  "!     when  this  module  is  executed,  read  the  sample" 

51  SAY  "number  listed  on  the         !" 

0  SAY  " !     form  and  compare  it  to  the  list  you  have  for" 

50  SAY  "the  computer  center's         !" 

0  SAY  " !     operations  for  Julian  date" 

31  SAY  date 

46  SAY  "The  numbers  this  system  !" 

0  SAY  " !     has  generated  refer  to  the  position  of  the  ev" 

50  SAY  "ents  on  that  list  !" 

0  SAY  "!     (i.e.:  Sample  Number  5  refers  to  the  5th  item" 

51  SAY  "on  the  list,  etc.),  I" 

0  SAY  "!     and  this  determines  those  events  you  must  ins" 

50  SAY  "pect  according  to  !" 

0  SAY  "!     published  Quality  Control  Standards." 

7  9  SAY  " !" 

0  SAY  " ! " 

7  9  SAY  "!" 

0  SAY  "+=================================================" 

5  0  SAY  •»=============================+" 
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*  MODULE  3 . 0 

*  INPUT.CMD      VERSION  1.5  12  APR  8  4  HEM 

*  This  module  allows  the  user  to  input  the  IRR  numbers  to  be 

*  inspected,  the  results  of  the  inspection  process,  and  to  make 

*  any  changes  to  the  IRR's  which  may  be  required. 

*  CALLED  BY  MAIN.CMD 

SAVE  TO  keepem 

CLEAR 

RESTORE  FROM  keepem 

*  Specify  file  to  be  used. 
USE  b:irr 

*  Prevent  calculations  from  showing  on  screen 
SET  TALK  OFF 

*  Initialize  variables 
STORE  Y  to  t:Imore 

STORE  "Data  Input"  TO  mode 

*  Set  up  DO  loop 
DO  WHILE  trlmore 

STORE  "  "  TO  t: order 

SET  FORMAT  TO  inputl 
READ 

DO  CASE 

CASE  t: order  =  "1" 
DO  sampspec 

CASE  t: order  =  "2" 
DO  inspres 

CASE  t: order  =  "3" 
DO  setjuln 

OTHERWISE 

STORE  n  TO  trlmore 

ENDCASE 
ENDDO 

*  Release  temporary  memory  variables 
RELEASE  ALL  LIKE  t:* 

RETURN 
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*  MODULE  3.0.1 

*  INPUT1.FMT    VERSION  1.2 


10  APR  8  4 


HEM 


9 

9 

10 

10 

11 
11 

12 
12 

13 
13 
14 
14 
14 
15 
15 
16 
16 


35 

0 
50 

0 
79 

0 
50 

0 
79 

0 
79 

0 
79 

0 
79 

0 
79 

0 
51 

0 
79 

0 
79 

0 
79 

0 
43 
79 

0 
79 

0 
50 


SAY 
SAY 
SAY 
SAY 
SAY 
SAY 
SAY 
SAY 
SAY 
SAY 
SAY 
SAY 
SAY 
SAY 
SAY 
SAY 
SAY 
SAY 
SAY 
SAY 
SAY 
SAY 
SAY 
SAY 
SAY 
SAY 
GET 
SAY 
SAY 
SAY 
SAY 
SAY 


Data  Input" 


At  this  point  you  may  choose  one  of  four  opti" 
ons:  !" 


1.  Enter  IRR  numbers" 


2.  Enter  inspection  results" 


3.  Change  the  Julian  Date,  and  enter  data  for" 
a  different  day  ! " 


4.  Return  to  the  Main  Menu" 


PLEASE  CHOOSE  ONE  OPTION  AT  THIS  TIME:" 
order 


:+» 
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*  MODULE  3.1 

*  SAMPSPEC.CMD     VERSION  1.2    10  MAR  8  4  HEM 

*  This  module  allows  the  user  to  input  the  IRR  numbers  to  be 

*  inspected  and  then  automatically  generates  the  required 

*  timeliness  and  quality  reports  to  be  filled  in  by  QAE 

*  personnel. 

*  THIS  MODULE  CALLED  BY:  INPUT.CMD 

SAVE  TO  keepem 

CLEAR 

RESTORE  FROM  keepem 

*  Prevent  calculations  from  showing  on  screen 
SET  TALK  OFF 

*  Initialize  variables 
STORE  Y  TO  t:more 
STORE  0  TO  t:TYM 
STORE  0  TO  t:R 

STORE  "Sample  Identification"  TO  mode 

DO  setjuln 
USE  b:irr 

*  Set  up  the  loop 
DO  WHILE  t:more 

ERASE 

@  2,2  SAY  "JULIAN  DATE  " 

@  2,14  SAY  date 

? 

? 

APPEND  BLANK 

REPLACE  Julian  WITH  date 

INPUT  "Time"  TO  t:TYM 
REPLACE  time  WITH  t:TYM 

INPUT  "Record  Number"  TO  t:R 
REPLACE  recno  WITH  t:R 

INPUT  "Any  more  IRR 's  to  enter  for  this  date?  (Y  or  N)"  TO  trmore 

DO  timerpt 

DO  qualrpt 

SET  FORMAT  TO  PRINT 

EJECT 
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SET  FORMAT  TO  SCREEN 
ENDDO 

*  Release  all  temporary  memory  variables 
RELEASE  ALL  LIKE  t:* 
RETURN 
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*  MODULE  3.1.1 

*  TIMERPT.CMD   VERSION  1 


1  APR  8  4 


HEM 


SET  FORMAT  TO  PRINT 

SET  MARGIN  TO   10 

8   2,31 

SAY 

"TIMELINESS  REPORT" 

8   4,  0 

SAY 

" IRR  No : " 

e    4,  8 

SAY 

JULIAN 

8   4,15 

SAY 

TIME 

e    4,21 

SAY 

RECNO 

8   4,28 

SAY 

II  m  II 

8   6,  0 

SAY 

"A.  Time  that  Gov't  provided  input: 

H 

@   8,  0 

SAY 

"B.  Time  Event/Output  was  completed: 

ii 

8  10,  0 

SAY 

"C.  Throughput  (B  -  A) 

8  12,  0 

SAY 

"D.  Standard: 

8  14,  0 

SAY 
SAY 
SAY 

"E.  Accept/Reject:             " 

8  16,  0 
8  16,50 

ii                           ii 

8  17,  0 

SAY 

"Rejection  caused  by:" 

8  49,40 

SAY 
SAY 
SAY 
SAY 
SAY 

"Contractor  Caused  (Y/N) :           " 

8  51,40 

"Government  Caused  (Y/N):           " 

8  53,40 

"Database  Updated? 

8  56,40 

ii                                     ii 

8  57,40 

"NARDAC  S.F. " 

8  58,40 

SAY 

"QAE  Representative" 

SET  FORMAT  TO  SCREEN 

RETURN 
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*  MODULE  3.1.2 

*  QUALRPT.CMD   VERSION  1 

SET  FORMAT  TO  PRINT 
SET  MARGIN  TO   10 
@   3,33  SAY  "QUALITY  REPORT" 
§   5,0  SAY  "IRR  No:" 
8  SAY  JULIAN 
15  SAY  TIME 
21  SAY  RECNO 
28  SAY  "Q" 
0  SAY  "Client  Command: 


1  APR  8  4 


HEM 


5 

5 

5 

5 

5 

7 

7 

9 

11 

13 

13 

14 

52 


@  55 
@  55 
@  56 
@  56 
@  57 
@  57 


5  0  SAY  " " 

0  SAY  "Is  the  Quality  Acceptable?  (Y/N 

0  SAY  "Is  it  Accurate?  (Y/N) 

0  SAY  "================================ 

5  0  SAY  "==========================" 

0  SAY  "Rejection  caused  by:" 

4  0  SAY  "Database  Updated?  " 

0  SAY  " 

5  0  SAY  " 


0  SAY  "Client  Command 
5  0  SAY  "." 

0  SAY  "Representative 
50  SAY  "entative" 
SET  FORMAT  TO  SCREEN 
RETURN 


NARDAC  S.F" 
QAE  Repres" 
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*  MODULE  3 . 2 

*  INSPRES.CMD   VERSION  2.2     2  4  MAR  8  4       HEM 

*  This  module  use  the  Julian  date  specified  in  SETJULN,  and 

*  accepts  the  time  and  record  number  to  determine  which  record  is 

*  to  be  updated.  It  then  allows  the  user  to  input  inspection 

*  results  to  the  specified  record. 

*  CALLED  BY:  INPUT.CMD 

*  FORMAT  FILE  USED:  INSPRES.FMT 

SAVE  TO  keepem 

CLEAR 

RESTORE  FROM  keepem 

*  Prevent  calculations  from  showing  on  screen 
SET  TALK  OFF 

*  Allow  both  upper  and  lower  case  inputs 
SET  EXACT  OFF 

STORE  "Inputting  Inspection  Results"  TO  mode 
DO  setjuln 

*  Specify  file  to  be  used 
USE  B:IRR 

*  Set  up  loop 
STORE  Y  TO  more 

*  Loop  program 
DO  WHILE  more 

*  Define  format 

SET  FORMAT  TO  inspres 

*  Initialize  variables 
STORE  0  TO  xtime 
STORE  0  TO  xrecno 
STORE  "  "  TO  xtype 
STORE  Y  TO  xtstep 

*  Execute 
READ 

STORE  ! (xtype)  TO  xtype 

*  Locate  the  record  whose  results  are  to  be  input 

LOCATE  FOR  Julian  =  date  .AND.  time  =  xtime  .AND.  recno  =  xrecno 

*  Ensure  the  record  exists.  If  not,  loop  back  to  INSPRES.FMT. 
IF  .NOT.  EOF 
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DO  CASE 

*  Input  the  results  of  timeliness  inspections 
CASE  ! (xtype)  =  "T" 

*  Set  T  report  flag  to  yes. 
REPLACE  T  WITH  xtstep 
ERASE 

@  2,2  SAY  "IRR  No. " 
@  2,10  SAY  date 
@  2,20  SAY  xtime 
@  2,30  SAY  xrecno 
@  2,4  2  SAY  xtype 
p 

*  Input  site  data 
ACCEPT  "SITE?"  TO  xsite 
REPLACE  site  WITH  ! (xsite) 


*  Input  results  of  timeliness  inspection. 
INPUT  "DID  THE  SAMPLE  PASS  THE  TIMELINESS  ; 
INSPECTION?"  TO  xtac 

REPLACE  taccept  WITH  xtac 
IF  xtac 

*  If  the  inspection  was  successful,  set  the 

*  time  problem  flag  to  no,  and  find  out  if  there 

*  are  any  more  inspection  results  to  input. 
STORE  N  TO  xt 

REPLACE  timeprob  WITH  xt 

INPUT  "Any  more  inspection  results  to  input  now?"; 
TO  more 


ELSE 


If  the  Inspection  was  not  successful,  set  the 
time  problem  flag  to  no,  find  out  if  the 
problem  was  the  result  of  system  problems  or 
was  the  fault  of  the  gov't.  Find  out  if  there 
are  any  more  inspection  results  to  input. 

STORE  N  TO  xt 

REPLACE  timeprob  WITH  xt 

ERASE 


@  2,2  SAY  "IRR  No. " 

@  2,10  SAY  date 

@  2,2  0  SAY  xtime 

§  2,30  SAY  xrecno 

@  2,4  2  SAY  xtype 


INPUT  "  WAS  THE  DISCREPANCY  THE  RESULT  OF  SYSTEM 
FAILURE?"  TO  xs 

REPLACE  system  WITH  xs 

INPUT  "  WAS  THE  DISCREPANCY  THE  FAULT  OF  THE  ; 
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GOVERNMENT?"  TO  xg 

REPLACE  govt  WITH  xg 

INPUT  "  Any  more  inspection  results  to  input?"; 
TO  more 
ENDIF 

*  Input  the  results  of  quality  inspections 
CASE  ! (xtype)  =  "Q" 

*  Set  the  Q  report  flag  to  yes. 
REPLACE  Q  WITH  xtstep 

ERASE 

*  Input  the  results  of  quality  inspections 

@  2,2  SAY  "IRR  No. " 

@  2,10  SAY  date 

@  2,2  0  SAY  xtime 

@  2,30  SAY  xrecno 

@  2,4  2  SAY  xtype 
p 
7 

INPUT  "DID  THE  SAMPLE  PASS  THE  QUALITY  ; 
INSPECTION?"  TO  xqac 

REPLACE  qaccept  WITH  xqac 

*  If  the  inspection  was  successful ,  set  the 

*  quality  problem  flag  to  no,  and  find  out  if 

*  there  are  any  more  inspection  results  to  input. 
IF  xqac 

INPUT  "Any  more  inspection  results  to  input  now?"; 
TO  more 
ELSE 

*If  the  inspection  was  not  successful,  set  the 

*  quality  problem  flag  to  yes,  and  find  out  if 

*  the  problem  was  one  of  accuracy  or  of  quality. 
ERASE 

@  2,2  SAY  "IRR  No. " 

@  2,10  SAY  date 

@  2,20  SAY  xtime 

@  2,30  SAY  xrecno 

@  2,4  2  SAY  xtype 
7 
p 

INPUT  "ACCURACY  DISCREPANCY?"  TO  xa 

REPLACE  accuprob  WITH  xa 

INPUT  "QUALITY  DISREPANCY?"  TO  xq 

REPLACE  qualprob  WITH  xq 

INPUT  "Any  more  inspection  results  to  input  now?"; 

TO  more 
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ENDIF 
ENDCASE 

*  Release  temporary  variables 
RELEASE  ALL  LIKE  x* 

ENDIF 
ENDDO 

*  Release  loop  variable 
RELEASE  more 

RETURN 
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*  MODULE  3.2.1 

*  INSPRES.FMT   VERSION  1.2 


2  4  MAR  8  4 


HEM 


@  10 
@  10 
@  10 
@  10 

e  io 

@  10 
@  10 

@  11 
@  11 

@  12 
@  12 


2  8  SAY 

0  SAY 

5  0  SAY 

0  SAY 

7  9  SAY 

0  SAY 

5  0  SAY 

0  SAY 

16  SAY 

2  8  SAY 
7  9  SAY 

0  SAY 

5  0  SAY 

0  SAY 

51  SAY 

0  SAY 

51  SAY 

0  SAY 

7  9  SAY 

0  SAY 

7  9  SAY 

0  SAY 

9  GET 

20  SAY 

3  0  GET 
41  SAY 
61  GET 
79  SAY 

0  SAY 

7  9  SAY 

0  SAY 

5  0  SAY 


'Input  Inspection  Results" 


i  ,  ii 


'!     You  are  now  ready  to  input  the  inspection  res" 

•ults  for  !" 

'  !     Julian  date" 

late 

'.  During  this  process  you  will  be  asked  several" 
i  ,  n 

'!     questions.  When  asked  for  the  site  of  the  ins" 

'pection,  input  the  first      !" 

'!     letter  of  the  site  (A  =  Alameda,  L  =  Lemoore , " 

'M  =  Moffett,  etc.),  or       I" 

'!     type  of  report  (T  =  Timeliness,  Q  =  Quality)." 

'For  all  the  other  1 " 

'!     questions,  reply  with  Y  (Yes)  or  N  (No)." 
i  ,  M 

i  ,  H 

i  ,  ii 

'!     Time" 
xtime 

'Record  No . " 
xrecno 

'Report  Type  (T  or  Q ) " 

xtype 
i  ,  ii 

i  ,  ii 

i  ,  ii 
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*  MODULE  4.0 

*  ANALYZE.CMD  VERSION  1.2       12  APR  8  4     HEM 

*  This  module  takes  the  data  input  from  INSPRES.CMD,  compares  it 

*  with  information  in  DAYDATA,  and  in  accordance  with  MIL  STD  - 

*  105D  accepts  or  rejects  that  day's  work.  The  module  then  sets 

*  the  recommended  inspection  level  for  the  next  day,  and  makes 

*  reports  as  needed  to  QA  personnel. 

*  CALLED  BY:  MAIN.CMD 

*  FORMAT  FILE  USED:  ANALYZEl.FMT 

SAVE  TO  keepem 

CLEAR 

RESTORE  FROM  keepem 

*  Prevent  calculations  from  showing  on  screen 
SET  TALK  OFF 

*  Allow  both  upper  and  lower  case  inputs 
SET  EXACT  OFF 

*  Initialize  variables 
STORE  0  TO  date 

*  Give  the  user  something  to  read 
ERASE 

SET  FORMAT  TO  ANALYZEl 

READ 

*DO  delay2 

*  Ensure  that  all  samples  for  the  day  in  question  have  been 

*  inspected,  and  that  both  T  and  Q  reports  are  in  for  all 

*  samples. 
DO  SAMPCHEK 

*  Determine  whether  the  day's  work  is  accepted  or  rejeted. 
DO  SAMPANAL 

*  Prescribe  the  recommended  inspection  level  for  the  next  day's 

*  work. 

DO  INSPANAL 

*  Make  required  reports 
DO  INSPRPT 

*  Return  to  the  Main  Menu 
RETURN 
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*  MODULE  4.0.1 

*  ANALYZEl.FMT 


VERSION  1.2 


2  4  MAR  8  4 


HEM 


@  10 
@  10 

@  11 
@  11 
@  12 

@  12 
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GET 
SAY 
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SAY 
SAY 
SAY 
SAY 
SAY 
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SAY 
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SAY 
SAY 


'Sample  Analysis" 


:+" 


i  ,  II 
I  ,  ii 

1 !     At  this  time,  the  program  will  analyze  the  da' 

'ta  input  previously.  !" 

i  ,  ii 

i  ,  H 

'  !     FOR  WHICH  JULIAN  DATE  IS  ANALYSIS  TO  BE  DONE?1 

late 
i  |  M 

i  ,  ii 

i  ,  ii 

'!     You  will  be  informed  when  analysis  is  complet' 

'e,  and  requested  to  !" 

i  ,  ii 

i  ,  ii 

'!     choose  output  options  at  that  time." 
i  |  ii 

i  ,  ii 

i  ,  ii 


:+» 
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*  MODULE  4 . 1 

*  SAMPCHEK.CMD   VERSION  1.2      12  APR  8  4      HEM 

*  This  module  ensures  that  all  samples  for  the  day  in  question 

*  have  been  inspected,  and  that  both  T  and  Q  reports  are 

*  completed  for  all  samples. 

*  CALLED  BY:  ANALYZE.CMD 

*  FORMAT  FILE  USED:  SAMPCHEK.FMT 

SAVE  TO  keepem 

CLEAR 

RESTORE  FROM  keepem 

USE  b:daydata 

LOCATE  FOR  Julian  =  date 

SELECT  SECONDARY 
USE  b:irr 

COUNT  FOR  Julian  =  date  TO  daycount 

*  Ensure  all  samples  have  been  input  for  the  day  specified 
IF  daycount  <>  samps 

ERASE 
DO  errorl 
DO  delay2 
DO  input 

ELSE 

*  Ensure  both  reports  in  for  all  samples  for  the  day  specified 
LOCATE  FOR  Julian  =  date  .AND.  .NOT.  T  .OR.; 
Julian  =  date  .AND.  .NOT.   Q 

IF  .NOT.  EOF 

DO  error2 

DO  delay2 

DO  input 
ENDIF 

ENDIF 

RELEASE  daycount 

*  Return  to  the  calling  program 
RETURN 
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*  MODULE  4.1.1 

*  ERRORl.CMD    VERSION  1.0 


12  APR  8  4 


HEM 


ERASE 


e  io 

@  10 

i  ii 
i  ii 

@  12 

@  12 

@  13 

@  13 

@  14 

@  14 

@  15 

@  15 

@  16 

e  i6 
e  17 

@  17 
RETURN 
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»+: 


:+» 


ERROR!   ERROR!   ERROR!   ERROR" 


ERROR ! 


i  » 


ii 

II  T?   II 


YOU  HAVE  NOT  ENTERRED  ALL  THE  RECORDS  FOR  DAT" 


E1 
Julian 


"HI 


YOU  WILL  BE  RETURNED  TO  THE  INPUT  OPTION  AT  T" 
S  TIME  TO  COMPLETE  ! " 


INPUT  ACTION  FOR  THIS  DATE." 


'+= 


=+" 
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*  MODULE  4.1.2 

*  ERROR2.CMD    VERSION  1.0 


12  APR  8  4 


HEM 


ERASE 
@   4 


@ 
§ 
@ 
@ 
@ 
@ 

@ 
@ 

@ 

0 
§ 
@ 

ia 
@ 
@ 

@ 
@ 

@ 

@ 
@ 
@ 

RETURN 
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'+= 


:+» 


ERROR! 


ERROR!   ERROR!   ERROR!   ERROR" 
i  " 


ON  AT  LEAST  ONE  SAMPLE  FOR  JULIAN  DATE" 
lulian 
YOU  FAILED  TO  ! " 

;  " 

i  « 

!  INPUT  BOTH  THE  T  AND  Q  INSPECTION  REPORTS.  YO" 
U  WILL  BE  RETURNED  TO  !" 

i  " 

i  ■■ 

!  THE  INPUT  OPTION  AT  THIS  TIME  TO  INPUT  THE  RE" 
QUIRED  REPORTS.  ! " 

i  " 

i  " 


:+" 
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*  MODULE  4 . 2 

*  SAMPANAL.CMD     VERSION  1.1     9  MAY  84         HEM 

*  This  module  analyzes  the  inspection  results  input  in  the  input 

*  section,  and  determines  first,  whether  the  day's  results  passed 

*  the   inspection,   and   second,   (in  the  case   of   the   reduced 

*  inspection  level )  what  level  of  inspection  should  be  used  for 

*  the  next  day. 

*  NOTE!  AS  PRESENTED,  THIS  MODULE  REFLECTS  MIL-STD-105D  FOR  AN 

*  AQL  OF  2.5.  SHOULD  THIS  AQL  BE  CHANGED,  IT  IS  MANDATORY  THAT 

*  THIS  MODULE  BE  CHANGED  TO  REFLECT  THAT  CHANGE  IN  AQL! 

SAVE  TO  keepem 

CLEAR 

RESTORE  FROM  KEEPEM 

*  CALLED  BY:  ANALYZE.CMD 
STORE  N  TO  taccept 

USE  b:irr 

*  Determine  the  total  number  of  bad  samples 

COUNT  FOR  Julian  =  date  .AND.  .NOT.  qaccept  .AND.  NOT.  govt  .OR.; 
Julian  =  date  .AND.  .NOT.  taccept  .AND.  .NOT.  govt  TO  rejectno 

USE  b:daydata 

LOCATE  FOR  Julian  =  date 

*  Determine  whether  to  accept  or  reject  the  day's  work 
DO  CASE 

CASE  finsplvl  =  "Normal" 
DO  CASE 

CASE  samps  =2  .OR.  samps  =  3  .OR.  samps  =  5  .  OR.  ; 
samps  =  8 

IF  rejectno  =  0 

STORE  Y  TO  taccept 

ENDIF 

CASE  samps  =  13  .OR.  samps  =20 
IF  rejectno  <=  1 

STORE  Y  TO  taccept 
ENDIF 

CASE  samps  =  32 

IF  rejectno  <=  2 

STORE  Y  TO  taccept 
ENDIF 
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CASE  samps  =  50 

IF  rejectno  <=  3 

STORE  Y  TO  taccept 
ENDIF 

CASE  samps  =80 

IF  rejectno  <=  5 

STORE  Y  TO  taccept 
ENDIF 

CASE  samps  =  125 

IF  rejectno  <=  7 

STORE  Y  TO  taccept 
ENDIF 

CASE  samps  =  200 

IF  rejectno  <=  10 

STORE  Y  TO  taccept 
ENDIF 

CASE  samps  =  315 

IF  rejectno  <=  14 

STORE  Y  TO  taccept 
ENDIF 

CASE  samps  >=  500 

IF  rejectno  <=  21 

STORE  Y  TO  taccept 
ENDIF 

ENDCASE 

*  Determine  whether  to  accept  or  reject  the  day's  work 
CASE  finsplvl  =  "Tightened" 
DO  CASE 

CASE  samps  =  2  .OR.  samps  =  3  .OR.  samps  =  5  . OR.  ; 
samps  =  8 

IF  rejectno  =  0 

STORE  Y  TO  taccept 

ENDIF 

CASE  samps  =  13  .OR.  samps  =  20  .OR.  samps  =  32 
IF  rejectno  <=  1 

STORE  Y  TO  taccept 
ENDIF 

CASE  samps  =  50 

IF  rejectno  <=  2 

STORE  Y  TO  taccept 
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ENDIF 

CASE  samps  =80 

IF  rejectno  <=  3 

STORE  Y  TO  taccept 
ENDIF 

CASE  samps  =  125 

IF  rejectno  <=  5 

STORE  Y  TO  taccept 
ENDIF 

CASE  samps  =  200 

IF  rejectno  <=  8 

STORE  Y  TO  taccept 
ENDIF 

CASE  samps  =  315 

IF  rejectno  <=  12 

STORE  Y  TO  taccept 
ENDIF 

CASE  samps  >=  500 

IF  rejectno  <=  18 

STORE  Y  TO  taccept 

ENDIF 

ENDCASE 

*  Determine  whether  to  accept  or  reject  the  day's  work 

*  Determine  the  recommended  inspection  level  for  the  next  day 

CASE  finsplvl  =  "Reduced" 
DO  CASE 

CASE  samps  =  2  .OR.  samps  =  3 
IF  rejectno  =  0 

STORE  Y  TO  taccept 

REPLACE  rcmdinsp  WITH  "Reduced" 
ELSE 

REPLACE  rcmdinsp  WITH  "Normal" 
ENDIF 

CASE  samps  =  5  .OR.  samps  =  8 
DO  CASE 

CASE  rejectno  =  0 

STORE  Y  TO  taccept 

REPLACE  rcmdinsp  WITH  "Reduced" 

CASE  rejectno  =  1 

STORE  Y  TO  taccept 
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REPLACE  rcmdinsp  WITH  "Normal" 

CASE  rejectno  >=  2 

STORE  N  TO  taccept 

REPLACE  rcmdinsp  WITH  "Normal" 

ENDCASE 

CASE  samps  =13 
DO  CASE 

CASE  rejectno  <=  1 

STORE  Y  TO  taccept 

REPLACE  rcmdinsp  WITH  "Reduced" 

CASE  rejectno  =  2 

STORE  Y  TO  taccept 

REPLACE  rcmdinsp  WITH  "Normal" 

CASE  rejectno  >=  3 

STORE  N  TO  taccept 

REPLACE  rcmdinsp  WITH  "Normal" 

ENDCASE 


CASE  samps  =  20 
DO  CASE 

CASE  rejectno  <=  1 

STORE  Y  TO  taccept 

REPLACE  rcmdinsp  WITH  "Reduced" 

CASE  rejectno  >  1  .AND.  rejectno  <=  3 
STORE  Y  TO  taccept 
REPLACE  rcmdinsp  WITH  "Normal" 

CASE  rejectno  >=  4 

STORE  N  TO  taccept 

REPLACE  rcmdinsp  WITH  "Normal" 

ENDCASE 

CASE  samps  =32 
DO  CASE 

CASE  rejectno  <=  2 

STORE  Y  TO  taccept 

REPLACE  rcmdinsp  WITH  "Reduced" 

CASE  rejectno  >  2  .AND.  rejectno  <=  4 
STORE  Y  TO  taccept 
REPLACE  rcmdinsp  WITH  "Normal" 
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CASE  rejectno  >=  5 

STORE  N  TO  taccept 

REPLACE  rcmdinsp  WITH  "Normal" 

ENDCASE 

CASE  samps  =50 
DO  CASE 

CASE  rejectno  <=  3 

STORE  Y  TO  taccept 

REPLACE  rcmdinsp  WITH  "Reduced" 

CASE  rejectno  >  3  .AND.  rejectno  <=  5 
STORE  Y  TO  taccept 
REPLACE  rcmdinsp  WITH  "Normal" 

CASE  rejectno  >=  6 

STORE  N  TO  taccept 

REPLACE  rcmdinsp  WITH  "Normal" 

ENDCASE 

CASE  samps  =  80 
DO  CASE 

CASE  rejectno  <=  5 

STORE  Y  TO  taccept 

REPLACE  rcmdinsp  WITH  "Reduced" 

CASE  rejectno  >  5  .AND.  rejectno  <=  7 
STORE  Y  TO  taccept 
REPLACE  rcmdinsp  WITH  "Normal" 

CASE  rejectno  >=  8 

STORE  N  TO  taccept 

REPLACE  rcmdinsp  WITH  "Normal" 

ENDCASE 

CASE  samps  =  125 
DO  CASE 

CASE  rejectno  <=  7 

STORE  Y  TO  taccept 

REPLACE  rcmdinsp  WITH  "Reduced" 

CASE  rejectno  >  7  .AND.  rejectno  <=  9 
STORE  Y  TO  taccept 
REPLACE  rcmdinsp  WITH  "Normal" 

CASE  rejectno  >=  10 
STORE  N  TO  taccept 
REPLACE  rcmdinsp  WITH  "Normal" 
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ENDCASE 

CASE  samps  >=  200 
DO  CASE 

CASE  rejectno  <=  10 
STORE  Y  TO  taccept 
REPLACE  rcmdinsp  WITH  "Reduced" 

CASE  rejectno  >  10  .AND.  rejectno  <=  12 
STORE  Y  TO  taccept 
REPLACE  rcmdinsp  WITH  "Normal" 

CASE  rejectno  >=  13 
STORE  N  TO  taccept 
REPLACE  rcmdinsp  WITH  "Normal" 

ENDCASE 

ENDCASE 

ENDCASE 

IF  taccept 

REPLACE  accept  WITH  Y 
ENDIF 

*  Perform  Deduct  Analysis 
STORE  samps  TO  sampnum 

STORE  1000  *  (rejectno  /  sampnum)  TO  fails 
STORE   fails  *  .01  TO  fails 
REPLACE  failrate  WITH  fails 

*  Return  to  calling  program 
RETURN 
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*  MODULE  4 . 3 

*  INSPANAL.CMD     VERSION  1.1       9  MAY  8  4       HEM 

*  This  module  takes  the  results  of  SAMPANAL  for  the  current 

*  day,  as  well  as  several  other  preceding  days,  to  determine 

*  which  level  of  inspection  to  recommend  for  the  next  day. 

SAVE  TO  keepem 

CLEAR 

RESTORE  FROM  keepem 

*  CALLED  BY:  ANALYZE.CMD 

STORE  0  TO  nobadays 

USE  b:daydata 

INDEX  ON  Julian  TO  daydex 

LOCATE  FOR  Julian  =  date 

*  Determine  the  recommended  inspection  level  for  the  next  day 
DO  CASE 

CASE  finsplvl  =  "Normal" 
SKIP  -4 

COUNT  NEXT  5  FOR  .NOT.  accept  TO  nobadays 
IF  nobadays  >=  2 

LOCATE  FOR  Julian  =  date 

REPLACE  rcmdinsp  WITH  "Tightened" 
ELSE 

LOCATE  FOR  Julian  =  date 

SKIP  -9 

COUNT  NEXT  10  FOR  .NOT.  accept  TO  nobadays 

IF  nobadays  =  0 

REPLACE  rcmdinsp  WITH  "Reduced" 

ELSE 

REPLACE  rcmdinsp  WITH  "Normal" 

ENDIF 
ENDIF 


CASE  finsplvl  =  "Tightened" 
LOCATE  FOR  Julian  =  date 
SKIP  -4 

COUNT  NEXT  5  FOR  .NOT.  accept  TO  nobadays 
IF  nobadays  =  0 

REPLACE  rcmdinsp  WITH  "Normal" 
ELSE 

LOCATE  FOR  Julian  =  date 

SKIP  -9 

COUNT  NEXT  10  FOR  .NOT.  accept  to  nobadays 

IF  nobadays  >=  10 
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REPLACE  rcmdinsp  WITH  "Terminate" 
ELSE 

REPLACE  rcmdinsp  WITH  "Tightened" 

ENDIF 
ENDIF 

ENDCASE 
RELEASE  nobadays 

SAVE  TO  keepem 

CLEAR 

RESTORE  FROM  keepem 

*  Return  to  the  calling  program 
RETURN 
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*  MODULE  4 . 4 

*  INSPRPT.CMD    VERSION  1.0      12  APR  84       HEM 

*  This  module  takes  the  inspection  results  generated 

*  previously,  and  prepares  the  Quality  Assurance  Reports. 

SAVE  TO  keepem 

CLEAR 

RESTORE  FROM  keepem 

USE  b:daydata 

LOCATE  FOR  Julian  =  date 

STORE  finsplvl  TO  insplvl 
STORE  samps  TO  sampnum 
STORE  events  TO  eventno 
STORE  rcmdinsp  TO  rcmd 

IF  accept 

STORE  "  accepted."  to  tres 
ELSE 

STORE  "  rejected."  to  tres 
ENDIF 

*  Determine  the  type  of  output  format  to  use.  If  terminate, 

*  output  the  termination  report,  otherwise  output  the 

*  status  report. 

IF  rcmdinsp  =  "Terminate" 

SET  FORMAT  TO  termrpt 

READ 
ELSE 

SET  FORMAT  TO  statrpt 

READ 

SET  TALK  OFF 

WAIT 

SET  TALK  ON 
ENDIF 

*  Return  to  the  calling  program 

RETURN 
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*  MODULE  4.4.1 

*  STATRPT.FMT   VERSION  2.0 


12  APR  8  4 


HEM 
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(a 
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5  SAY  "STATUS  REPORT  FOR  JULIAN  DATE" 

3  5  SAY  date 

5  SAY  "As  of" 

11  SAY  date 

21  SAY  ",  the  status  of  the  contractor's  performance" 

5  SAY  "is  as  follows:" 

5  SAY  "Inspection  of  samples  on" 

3  0  SAY  date 

42  SAY  "was  conducted  under  the" 

5  SAY  insplvl 

16  SAY  "Inspection  Level,  and  the  contractor's  work  for  th" 

66  SAY  "at  day" 

5  SAY  "was" 

9  SAY  tres 

5  SAY  "Number  of  jobs  processed  by  contractor  on" 

4  7  SAY  date 

5  7  SAY  ":" 

5  9  SAY  eventno 

5  SAY  "Number  of  samples  taken  by  QA  personnel:" 

4  5  SAY  sampnum 

5  SAY  "Number  of  samples  which  failed  inspection:" 

48  SAY  rejectno 

5  SAY  "As  a  result  of  the  above  findings,  and  in  accordan" 

55  SAY  "ce  with" 

5  SAY  "Mil  Std-105D,  it  is  recommended  that  the  contract" 

55  SAY  "be  continued," 

5  SAY  "and  that  the  contractor's  work  for  the  next  day  be" 

56  SAY  "inspected  under" 
5  SAY  "the" 

9  SAY  rcmd 

20  SAY  "level  of  inspection." 
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*  MODULE  4.4.2 

*  TERMRPT.FMT   VERSION  1.0 


12  APR  8  4 


HEM 


@  3,2  2  SAY 

§  5,  5  SAY 

@  5,5  5  SAY 

@  6,5  SAY 

@  6,5  5  SAY 

@  7,  5  SAY 

@  7,5  5  SAY 

@  8,5  SAY 

g  8,5  5  SAY 

@  9,  5  SAY 

@  9,5  5  SAY 

§  10,  5  SAY 

@  10,55  SAY 


'ATTENTION!    ATTENTION!    ATTENTION!" 

'As  a  result  of  the  contractor  having  been  placed  o" 

'n  Tightened" 

'Inspection  for  the  previous  ten  days,  and  as  the  c" 

'ontractor 's " 

'work  has  failed  inspection  for  all  of  those  ten  da" 

•ys;  in" 

'accordance  with  the  procedures  set  forth  in  Mil  St" 

'd-105D  it" 

'is  recommended  that  the  inspection  process  now  be" 

'suspended, " 

'and  that  the  contractor  be  placed  in  default  of  co" 

'ntract. " 
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*  MODULE  5 . 0 

*  UTILITY.CMD        VERSION  1.0     2  MAY  8  4        HEM 

*  This  is  the  menu  module  for  all  utility  programs. 

ERASE 

@  10,10  SAY  "THIS  IS  THE  UTILITY  MENU  PROGRAM  STUB" 

@  14,10  SAY  "Press  any  key  to  continue." 


WAIT 
RETURN 


174 


INITIAL  DISTRIBUTION  LIST 


No.  Copies 


1.  Defense  Technical  Information  Center  2 
Cameron  Station 

Alexandria,  Virginia   22314 

2.  Library,  Code  0142  2 
Naval  Postgraduate  School 

Monterey,  California   93943 

3 .  Commander  1 
Naval  Data  Automation  Command 

Washington  Navy  Yard 
Washington,  D.C.   20374 

4.  Commanding  Officer  1 
Naval  Regional  Data  Automation  Center, 

San  Francisco 
Naval  Air  Station 
Alameda,  California   94501 

5.  Commanding  Officer  1 
Naval  Regional  Data  Automation  Center, 
Jacksonville 

Naval  Air  Station 
Jacksonville,  Florida   32212 

6.  Commanding  Officer  1 
Naval  Regional  Data  Automation  Center, 

New  Orleans 

New  Orleans,  Louisiana   70145 

7.  Commanding  Officer  1 
Naval  Regional  Data  Automation  Center, 
Norfolk 

Norfolk,  Virginia   23511 

8.  Commanding  Officer  1 
Naval  Regional  Data  Automation  Center 

Naval  Air  Station 
Pensacola,  Florida   32508 

9.  Commanding  Officer  1 
Naval  Regional  Data  Automation  Center, 

San  Diego 

Naval  Air  Station,  North  Island 

San  Diego,  California   92135 


175 


10.  Commanding  Officer 

Naval  Regional  Data  Automation  Center, 
Washington 

Washington  Navy  Yard 
Washington,  D.C.   20374 

11.  Commanding  Officer 

Naval  Regional  Data  Automation  Center, 

Attn:  Mr.  Al  Hinds,  Code  5 OX 

San  Francisco 

NAS  Alameda,  California   94501 

12.  Captain  Michael  O'Neil,  USMC 
2804  Margate  St. 

Albany,  Georgia   31707 

13.  Captain  Keith  Lockett,  USMC 
107  Leisure  St. 
Stafford,  Virginia   22554 

14.  LT  Howard  Morton,  USN 
USS  Bradley  (FF  1041) 

FPO  San  Francisco,  CA  96601-1403 

15.  Professor  Dan  Boger  (Code  54  Bk) 
Naval  Postgraduate  School 
Monterey,  California  93943 

16.  Professor  Glenn  F.  Lindsay  (Code  55  Ls ) 
Naval  Postgraduate  School 

Monterey,  California  93943 

17.  Computer  Technology  Curricular  Office 
(Code  37) 

Naval  Postgraduate  School 
Monterey,  California  93943 


176 


lC)C)Jr    i 


Th<  thesis 

M^\  M8U0U    Morton 

i  c  x         An  automated  quality 
assurance  sureillance 
plan  for  ADP  opera- 
tions under  the  Navy's 
commercial  activities 
program. 

31  DEC  87  ,9t86 

31  DEC  e7  5  Z  5  »  w 


Thesis 

M8U0U    Morton 

c.l         An  automated  quality 
assurance  sureillance 
plan  for  ADP  opera- 
tions under  the  Navy's 
commercial  activities 
program. 


